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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students' proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Washington, 2,737 students in 
104 public schools were assessed. This report describes the reading 
proficiency of Washington fourth-graders and compares their overall 
performance to students in the West region of the United States and the 
nation (using data from the NAEP national assessments) . The distribution of 
reading results and reading achievement level results are provided for 
subpopulations of students (race/ethnicity, type of location, parents, 
educational level, and gender) . To provide a context for the assessment data, 
participating public school students, their reading teachers, and principals 
completed questionnaires which focused on: policies and practices related to 
reading (time for instructional activities and instructional resources for 
reading) ; delivery of reading instruction (instructional materials and 
activities, workbooks/ worksheets/writing, discussion and group activities, 
time to read, reading and use of libraries, assessing progress in reading) ; 
reading instructors (preparation, experience and professional development) ; 
students' home support for literacy (reading outside of school and in the 
home and hours of television watched per day) . The average reading 
proficiency of fourth-grade public school students in Washington on the NAEP 
reading scale was 213 compared to 212 nationwide. (SR) 
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actions to improve the form and use of the National Assessment. 
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Washington 



EXECUTIVE 

SUMMARY 




In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics. 1 The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories. 2 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
public school students in Washington, the West region, and the nation. The distribution 
of reading proficiency results and reading achievement level results are provided for 
groups of students defined by shared characteristics: race/ethnicity, type of location, 
parents’ education level, and gender. Contextual information about reading policies, 
instruction, and home support for reading is presented for public school students. State 
results are based on the representative sample of students who participated in the 1994 
Trial State Reading Assessment Program. Results for the region and the nation are based 
on the regional and national representative samples of students who participated in the 
national NAEP assessment. 



1 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement : NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 
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For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States . (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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Washington 



School and Student Participation in the Reading Assessment 

In Washington, 104 public schools participated in the 1994 fourth-grade reading 
assessment. This number includes participating substitute schools that were selected to 
replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1994 was 100 percent for public schools, 
which means that the fourth-grade students in this sample were directly representative 
of 100 percent of all the fourth-grade public school students in Washington. 

In Washington, 2,737 public school fourth-grade students were assessed in 1994. 
The weighted student participation rate was 94 percent for public schools. This means 
that the sample of fourth-grade students who took part in the assessment was directly 
representative of 94 percent of the eligible public school student population in 
participating schools in Washington (that is, all students from the population 
represented by the participating schools, minus those students excluded from the 
assessment). 

The overall weighted response rate (school rate times student rate) was 94 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 94 percent of the eligible fourth-grade public 
school population in Washington. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Washington. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Washington failed to meet minimum participation 
rate guidelines for non-public schools. Hence, only public school results are included 
in this report. Washington met all established NCES participation rate guidelines for 
public schools. 
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Washington 



Students’ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Washington, the West region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Washington on the NAEP reading scale was 213. This average was 
not significantly different from that of students across the nation 
(21 2). 3 The lowest performing 10 percent of public school fourth 
graders in Washington had proficiencies at or below 161 while the top 
10 percent had proficiencies at or above 259. In public schools across 
the nation, the lowest performing 10 percent of fourth graders had 
proficiencies at or below 156; the top performing 10 percent of students 
had proficiencies at or above 261. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table on the following 
page provides results for Washington, the West region, and the nation according to each 
reading purpose. 



3 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Washington 



1994, Public School Students 

The proficiency of public school students in Washington in reading for 
literary experience (216) was not significantly different from that of 
students across the nation (214). Similarly, in reading to gain 
information, the proficiency of public school students in Washington 

(209) did not differ significantly from that of students across the nation 

( 210 ) . 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). 



Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given on the following page. Chapter 3 provides further 
elaboration of these levels and presents examples of types of questions that students at 
each of the three achievement levels can respond to effectively. 
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Description of Fourth-Grade Reading Achievement 
Levels 



Achievement 

Level 


Scale 

Cutpoint 


Description 


ADVANCED 


268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


PROF 


ICIENT 


238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


BASIC 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Washington who were at 
or above the Proficient level (27 percent) did not differ significantly 
from that of students across the nation (28 percent). 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 4 The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 
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Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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Washington 



Race/Ethnicity 

1994 , Public School Students. The average reading proficiency of White 
students in Washington public schools was higher than that of Black and 
Hispanic students but was not significantly different from that of Asian, 
Pacific Islander, or American Indian students. 

Type of Location 

1994 , Public School Students. The average reading proficiency of 
Washington students attending public schools in central cities was not 
significantly different from that of students in urban fringe/large towns 
and rural areas/small towns. 

Parents’ Education Level 

1994, Public School Students. Public school students in Washington 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which was higher than that of students 
who reported that at least one parent had some education after high 
school, at least one parent graduated from high school, neither parent 
graduated from high school, or they did not know their parents’ 
education level. 



Gender 

1994, Public School Students. In public schools in Washington, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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A Context for Understanding Students* Reading Proficiency in Public Schools 

Information on the reading performance of students in Washington can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Washington are 
as follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Washington in 1994, average reading proficiency was similar for 
students regardless of how much time their reading teachers spent on 
reading instruction on a typical day. 

• According to the public school administrators in Washington, in 1994, 

65 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was 
smaller than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 16 percent of the students 
in public schools in Washington were typically taught reading in a class 
that was grouped by reading ability. The prevalence of ability grouping 
was not significantly different* across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Washington whose teachers used both basal and trade books 
demonstrated an average reading proficiency (215) which was higher 
than that of students whose teachers primarily used basal readers (202). 

• The proficiency of Washington students whose teachers used both basal 
and trade books (215) was not significantly different from that of 
students whose teachers primarily used trade books (216). 

• The proficiency of Washington students whose teachers primarily used 
trade books (216) was higher than that of students whose teachers 
primarily used basal readers (202). 




* Although the difference may appear 
Appendix A for further discussion.) 



large, recall that “significance” here refers to “statistical significance.” (See 
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• In Washington, 28 percent of the fourth-grade students had reading 
teachers who used children’s newspapers and/or magazines at least once 
a week; 18 percent of the students had reading teachers who used 
reading kits at least once a week; 17 percent had reading teachers who 
used computer software for reading instruction at least once a week; 
80 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 70 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Washington reading teachers, 55 percent of the 
students were asked to discuss new or difficult vocabulary almost every 
day. This percentage did not differ significantly from* that of students 
across the nation (62 percent). 

• According to their reading teachers, the percentage of students in 
Washington who were asked to talk with each other almost every day 
about what they have read (31 percent) was not significantly different 
from that of students across the nation, where 34 percent of the students 
were asked to do this activity almost every day. 

• According to the reading teachers in Washington, 6 percent of the 
students were asked to do a group activity or project about what they 
have read almost every day. This figure was not significantly different 
from that of students across the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Washington (42 percent) was not significantly different from that for 
the nation (41 percent). 

• About three quarters of the students (78 percent) had reading teachers 
who had the highest level of teaching certification that is recognized by 
Washington. This was greater than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Washington, 27 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was greater than the percentage of students across 
the nation who were being taught by reading teachers with the same 
major (20 percent). 
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HOME FACTORS 

• In Washington, 34 percent of the students reported having four types 
of reading materials (a newspaper, an encyclopedia, 25 or more books, 
and magazines) in the home. This figure was not significantly different 
from that for the nation (36 percent). Students in Washington who had 
all four of these types of materials in the home showed an average 
reading proficiency (222) which was higher than that of students with 
zero to two types of materials (201). 

• In 1994 in Washington, 26 percent of the students discussed with friends 
or family what they read almost every day. This percentage did not 
differ significantly from that of students across the nation (28 percent). 

The proficiency of students in Washington who discussed what they read 
with friends or family almost every day (212) did not differ significantly 
from that of students who had discussions with friends or family less 
than weekly (207). 

• Relatively few of the fourth-grade students (13 percent) watched six 
hours or more of television each day. This was smaller than the figure 
for the nation, where 22 percent of the students watched this much 
television. Average reading proficiency in Washington was lowest for 
students who spent six hours or more watching television each day. 

Comparisons of Overall Reading Proficiency in Washington with Other States 

The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Washington with that 
in other states (including Guam and the Department of Defense Education Activity 
[DoDEA] Overseas Schools) that participated in the NAEP 1994 Trial State Assessment 
Program. The different shadings of the states on the map show whether the average 
overall proficiency of public school students in the other states was statistically different 
from or not statistically different from that of public school students in Washington 
(‘Target State”)- States in black have a significantly lower average public school 
proficiency than does Washington. States with a dark-gray shading have a significantly 
higher average public school proficiency than does Washington. States with a light-gray 
shading have an average public school proficiency that does not differ significantly from 
that of Washington. The significance tests are based on a Bonferroni procedure for 
multiple comparisons that holds the probability of erroneously declaring the means of 
any two states to be different, when they are not, to no more than five percent. Two 
states — Idaho and Michigan — did not meet minimum school participation guidelines 
for public schools. Another jurisdiction — Washington, DC — withdrew from the Trial 
State Assessment after the data collection phase. Therefore, these three jurisdictions are 
not included in the comparisons depicted on the map on the following page. 
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The 1994 Trial State Assessment 

Comparisons of Overall Reading Proficiency 
Grade 4 Public Schools 

Washington 





Washington 



OVERVIEW 



F or over 25 years, the National Assessment of Educational Progress (NAEP) 
has been the nation’s primary indicator of student achievement, reporting on what 
students know and can do in various school subject areas at grades 4, 8, and 12. With 
legislation passed by Congress in 1988, NAEP’s mission of providing dependable and 
comprehensive information about educational progress in the United States was 
expanded to involve a voluntary state-by-state assessment on a trial basis. 

Consequently, the 1990 NAEP program included a Trial State Assessment 
Program in which public school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 5 Building on this initial effort, 
the 1992 NAEP program included a Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public school students assessed 
in 41 states, the District of Columbia, and two territories. 6 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students: 

The National Assessment shall conduct in 1994 . . . a trial reading 
assessment for the 4th grade , in states that wish to participate , with the 
purpose of determining whether such assessments yield valid and 
reliable State representative data . (Section 406(i)(2)(C)(i) of the 

General Education Provisions Act , as amended by Pub. L . 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 

The National Assessment shall include in each sample assessment . . . 
students in public and private schools in a manner that ensures 
comparability with the national sample. (Section 406(i)(2)(C)(i) of the 
General Education Provisions Act f as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 



5 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

6 For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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In addition to the state assessment program in reading at grade 4, the 1994 NAEP 
involved national assessments of reading, geography, and history at grades 4, 8, and 12. 

The 1994 Trial State Assessment Program was conducted in February 1994 with 
the following 44 participants: 
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Jurisdictions in italics — Montana, Washington, and the Department of Defense 
Education Activity (DoDEA) Overseas Schools — did not participate in the 1992 Trial 
State Assessment Program. Two states — Idaho and Michigan — did not meet minimum 
school participation guidelines for public schools. Another jurisdiction — Washington, 
DC — withdrew from the Trial State Assessment Program after the data collection 
phase. Therefore, public school results for these three jurisdictions are not reported. 
Three jurisdictions — Ohio, Oklahoma, and the Virgin Islands — participated in the 
1992 Trial State Assessment but not in the 1994 program. 

For the 1994 Trial State Assessment in reading, a combined sample of 
approximately 2,800 public and non-public school students was assessed in most 
jurisdictions. The samples were carefully designed to represent the fourth-grade 
populations in the states or jurisdictions. Participating jurisdictions were responsible for 
the administration of the assessment. For jurisdictions that participated in the 1992 Trial 
State Assessment Program, contractor staff monitored 25 percent of public school 
sessions and 50 percent of non-public school sessions. For jurisdictions that did not 
participate in 1992, contractor staff monitored 50 percent of both public and non-public 
school sessions. Monitoring efforts were part of a quality assurance program designed 
to ensure that sessions were conducted uniformly. 

The 1992 Trial State and National Assessment programs in reading were based 
on a framework developed through a national consensus process that was set forth by 
law and called for “active participation of teachers, curriculum specialists, subject matter 
specialists, local school administrators, parents, and members of the general public” 
(Pub. L. 100-297, Part C, 1988). 7 This same framework served as the basis of the 1994 
Trial State and National Assessment programs. 

7 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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The process of developing the framework was carried out in late 1989 and early 
1990 by the Council of Chief State School Officers (CCSSO) under contract from the 
National Assessment Governing Board (NAGB) which is responsible for formulating 
policy for NAEP, including developing assessment objectives and test specifications. 
The framework development process included gathering input from a wide range of 
people in the fields of reading and assessment, such as school teachers, administrators, 
and state coordinators of reading and reading assessment. After thorough discussion and 
some amendment, the framework was adopted by NAGB in March 1990. An overview 
of the reading framework is provided in Appendix A. 

The 1994 fourth-grade Trial State and National Assessments in reading consisted 
of eight sections or blocks, each 25 minutes in length. All fourth-grade students in the 
assessment were required to complete two blocks. Each block contained a passage or 
set of passages and a combination of constructed-response and multiple-choice 
questions. Passages selected for the assessment were drawn from authentic texts used 
by students in typical reading situations. Complete stories, articles, or sections of 
textbooks were used, rather than excerpts or abridgements. The type of question — 
constructed-response or multiple-choice — was determined by the objective being 
measured. In addition, the constructed-response questions were of two types: short 
constructed-response questions which required students to respond to a question in a few 
words or a few sentences and extended constructed-response questions which required 
students to respond to a question in a paragraph or more. 



This Report 

This is a computer-generated report that describes the reading performance of 
fourth-grade public school students in Washington, in the West region, and across the 
nation. A separate report describes additional fourth-grade reading assessment results 
for the nation and the states, as well as the national results for grades 8 and 12. 8 This 
report consists of four sections: 

• This Overview provides background information about the 1994 Trial 
State Assessment Program and a profile of the fourth-grade students in 
Washington. 

• Part One shows the distribution of reading proficiency results for 
fourth-grade public school students in Washington, the West region, and 
the nation. 

• Part Two presents reading achievement level results for public school 
fourth graders in Washington, the West region, and the nation. 

• Part Three relates fourth-grade public school students’ reading 
proficiency to contextual information about the reading policies, 
instruction, and home support for reading in Washington, the West 
region, and the nation. 



8 See NAEP 1994 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1995). 
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In this report, results are provided for groups of students defined by shared 
characteristics — race/ethnicity, type of location, parents’ education level, and gender. 
Based on criteria described in Appendix A, data are reported for subpopulations only 
where sufficient numbers of students and adequate school representation are present. 
For public school students, there must be at least 62 students in a particular subgroup 
from at least 10 different schools. However, the data for all students, regardless of 
whether their subgroup was reported separately, were included in computing overall 
results for Washington. Definitions of the subpopulations referred to in this report are 
presented below. 

The results for Washington are based on the representative sample of students who 
participated in the 1994 Trial State Assessment Program. The results for the nation and 
the region of the country are based on the nationally and regionally representative 
samples of students who were assessed in January through March as part of the national 
NAEP program. Using the national and regional results from the 1994 national NAEP 
program is necessary because of the voluntary nature of the Trial State Assessment 
Program. Since not every state participated in the program, the aggregated data across 
states did not necessarily provide representative national or regional results. Specific 
details on the samples and analysis procedures used can be found in the Technical Report 
of the 1994 NAEP Trial State Assessment Program in Reading . 9 

Race/Ethnicitv 

Results are presented for students of different racial/ethnic groups based on the 
students’ self- identification of their race/ethnicity according to the following mutually 
exclusive categories: White, Black, Hispanic, Asian, Pacific Islander, and American 
Indian (including Alaskan Native). 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, given the current NAEP sampling, does not support the reporting of regional 
results. Therefore, only state and national results will be presented. 



Central City: The Central City category includes central cities of all 
Standard Metropolitan Statistical Areas (SMSA’s). 10 Central City is a 
geographic term and is not synonymous with “inner city.” 




9 



Technical Report of the NAEP 1994 Trial State Assessment Program in Reading. (Washington, DC: National Center 
for Education Statistics, 1995). 



10 



Standard Metropolitan Statistical Area (SMS A) as defined by the Office of Management and Budget. 
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Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within SMSA’s that are classified as urban by 
the Bureau of the Census. A Large Town is defined as places outside 
SMSA’s with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside SMSA’s 
with a population of less than 25,000 but greater than or equal to 2,500. 

Parents’ Education Level 

Students were asked to indicate the extent of schooling for each of their parents 
— did not finish high school, graduated from high school, had some education after high 
school, graduated from college, or did not know. The response indicating the higher 
level of education was selected for reporting. Note that a substantial percentage of 
fourth-grade students did not know their parents’ education level. 

Gender 

Results are reported separately for males and females. 

Region 

The United States has been divided into four regions for purposes of this report: 
Northeast, Southeast, Central, and West. States included in each region are shown in 
Figure O.l. All 50 states and the District of Columbia are listed, with the participants 
in the 1 994 Trial State Assessment Program highlighted in boldface type. Guam and 
the Department of Defense Education Activity (DoDEA) Overseas Schools were not 
assigned to a region. Further, students attending public schools in the part of Virginia 
that is included in the Washington, DC, metropolitan statistical area are included in the 
Northeast regional results; students attending public schools in the remainder of the state 
are included in the Southeast regional results. Because most of the Virginia students 
are in the Southeast region, regional comparisons for Virginia are to the Southeast. 

Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples, as explained on the previous page. Thus, the regional results 
are based on a different and separate sample from that used to report the state results. 
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Note: Part of Virginia (near metropolitan Washington, DC) is included in the Northeast region, and the rest of Virginia 
is in the Southeast region. 



Guidelines for Analysis and Reporting 

This report describes reading performance for public school fourth graders and 
compares the results for various groups of students within that population — for 
example, those who have certain demographic characteristics or who responded to a 
specific background question in a particular way. The report examines the results for 
individual demographic groups and individual background questions. It does not include 
an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the percentages of students in these subpopulations and their average 
proficiencies are based on samples — rather than on the entire population of fourth 
graders in a jurisdiction — the numbers reported are necessarily estimates. As such, they 
are subject to a measure of uncertainty, reflected in the standard error of the estimate. 
When the percentages or average proficiencies of certain groups are compared, it is 
essential to take the standard error into account, rather than to rely solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based 
on statistical tests that consider both the magnitude of the difference between the means 
or percentages and the standard errors of those statistics. 
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The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the means or percentages are 
really different for those groups in the population. If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group means or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample means or sample percentages appear 
to be about the same or not. If the evidence is not sufficiently strong (i.e., the difference 
is not statistically significant), the means or percentages are described as being not 
significantly different — again, regardless of whether the sample means or sample 
percentages appear to be about the same or widely discrepant. The reader is cautioned 
to rely on the results of the statistical tests — rather than on the apparent magnitude of 
the difference between sample means or percentages — to determine whether those 
sample differences are likely to represent actual differences between the groups in the 
population. The statistical tests and Bonferroni procedure, which is used when more 
than two groups are being compared, are discussed in greater detail in Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 

Finally, in several places in this report, results (mean proficiencies and 
percentages) are reported in the text for combined groups of students. For example, in 
the text, the proficiency of students in the combined group who reported reading for fun 
once or twice a month or never or hardly ever is given and compared to the group who 
reported reading for fun almost every day. However, the table that accompanies that text 
reports percentages and proficiencies separately for the four groups (almost every day, 
once or twice a week, once or twice a month, and never or hardly ever). The combined 
group proficiencies reported in the text and used in all statistical tests are based on 
unrounded estimates (i.e., estimates calculated to several decimal places) of the 
proficiencies for each group. The percentages shown in the tables are rounded to 
integers. Thus, percentages may not always add up to 100 percent due to rounding. 
Also, the percentage for a combined group (reported in the text) may differ slightly from 
the sum of the separate percentages (presented in the tables) for each of the groups that 
were combined. Therefore, if statistical tests were to be conducted based on the rounded 
numbers in the tables, the results might not be consonant with the results of the statistical 
tests that are reported in the text (based on unrounded numbers). 
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Profile of Washington 



Fourth-Grade School and Student Characteristics 

Table 0.1 provides a profile of the demographic characteristics of the fourth-grade 
public school students in Washington, the West region, and the nation. This profile is 
based on data collected from the students and schools participating in the 1994 Trial 
State and National Assessments. As described earlier, the state data and the regional 
and national data are drawn from separate samples. 

Schools and Students Assessed 

Table 0.2 summarizes participation data for schools and students sampled in 
Washington for the 1994 Trial State Assessment. 11 In Washington, 104 public schools 
participated in the 1994 fourth-grade reading assessment. This number includes 
participating substitute schools that were selected to replace some of the nonparticipating 
schools from the original sample. The weighted school participation rate after 
substitution in 1994 was 100 percent for public schools, which means that the 
fourth-grade students in this sample were directly representative of 100 percent of all 
the fourth-grade public school students in Washington. 

In each school, a random sample of students was selected to participate in the 
assessment. In 1994, as estimated by the sample, 4 percent of the fourth-grade public 
school population were classified as Limited English Proficient (LEP), while 1 1 percent 
in public schools had an Individualized Education Plan (IEP). An IEP is a plan, written 
for a student who has been determined to be eligible for special education, that typically 
sets forth goals and objectives for the student and describes a program of activities 
and/or related services necessary to achieve the goals and objectives. Students with 
disabilities may be categorized as IEP. 

Schools were permitted to exclude certain students from the assessment, provided 
that certain criteria were met. To be excluded, a student had to be categorized as 
Limited English Proficient or had to have an Individualized Education Plan and (in 
either case) be judged incapable of participating in the assessment. The intent was to 
assess all selected students; therefore, all selected students who were capable of 
participating in the assessment should have been assessed. However, schools were 
allowed to exclude those students who, in the judgment of school staff, could not 
meaningfully participate. The NAEP guidelines for exclusion are intended to assure 
uniformity of exclusion criteria from school to school. Note that some LEP and IEP 
students were deemed eligible to participate and not excluded from the assessment. The 
students in Washington who were excluded from the assessment because they were 
categorized as LEP or had an IEP represented 5 percent of the public school population 
in grade 4. 



For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates 
for the Reading Assessment and Guidelines for Participation . (Washington, DC: National Center for Education 
Statistics, 1994); or see Appendix B of the Technical Report of the NAEP 1994 Trial State Assessment Program in 
Reading . (Washington, DC: National Center for Education Statistics, 1995). 
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Profile of Fourth-Grade Pubilc School Students in 
Washington , the West Region, and the Nation 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). The percentages 
for Race/Ethnicity may not add to 100 percent because some students categorized themselves as “Other.” 
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In Washington, 2,737 public school fourth-grade students were assessed in 1994. 
The weighted student participation rate was 94 percent for public schools. This means 
that the sample of fourth-grade students who took part in the assessment was directly 
representative of 94 percent of the eligible public school student population in 
participating schools in Washington (that is, all students from the population 
represented by the participating schools, minus those students excluded from the 
assessment). 

The overall weighted response rate (school rate times student rate) was 94 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 94 percent of the eligible fourth-grade public 
school population in Washington. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Washington. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Washington failed to meet minimum participation 
rate guidelines for non-public schools. Hence, only public school results are included 
in this report. Washington met all established NCES participation rate guidelines for 
public schools. 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth-grade public school population. For details of the nonresponse weighting 
adjustment procedures, see the Technical Report of the NAEP 1994 Trial State 
Assessment Program in Reading . 
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TABLE 0.2 

Profile of the Fourth-Grade Population Assessed in 
Washington 
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PART ONE 



The Reading Proficiency of Fourth-Grade 
Public School Students in Washington 



]R.eading involves the interaction between and among a reader, a text, and a 
situation. 12 Thus, students’ reading comprehension is influenced by the type of material 
read and the specific purposes for reading. The 1994 Trial State Assessment Program 



materials for different purposes. The fourth-grade reading assessment measured two 



information . 13 Students’ proficiency on each of the two purposes for reading was 
summarized on separate NAEP reading scales (one for each purpose), which range from 
0 to 500. In addition, results for an overall reading scale reflecting average proficiency 
across the two purposes for reading are also presented. The overall reading scale also 
ranges from 0 to 500. 

This part of the report contains two chapters that describe the reading proficiency 
of fourth-grade students in Washington. Chapter 1 compares the overall reading 
proficiency of public school students in Washington to the West region and the nation. 
It also presents the students’ average proficiency for the two purposes for reading. 
Chapter 2 summarizes reading proficiency for subpopulations of public school students 
defined by race/ethnicity, type of location, parents’ education level, and gender. 



12 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 

13 The eighth- and twelfth-grade national NAEP reading assessments also measured a third purpose for reading — reading 
to perform a task. 



considered students’ proficiency in situations that involved reading different kinds of 



global purposes for reading — reading for literary experience and reading to gain 
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CHAPTER 1 



Students’ Reading Proficiency 

In 1994, renewed emphasis was placed on national education goals when Congress 
reauthorized the Elementary and Secondary Education Act (ESEA) and enacted the Goals 
2000: Educate America Act. A concern for higher academic standards is evident in the 
ESEA' s efforts to provide programs to improve America’s schools. Goals 2000 reasserts 
the importance of establishing and meeting rigorous goals in the education of our 
nation’s students — All students will leave grades 4, 8 , and 12 having demonstrated 
competency over challenging subject matter including English , mathematics , science , 
foreign languages , civics and government , economics , arts , history , and geography, and 
every school in America will ensure that all students learn to use their minds well, so they 
may be prepared for responsible citizenship, further learning, and productive employment 
in our nation's modem economy. Reading ability can be viewed as an enabling skill for 
reaching these goals. Therefore, concern about attaining these goals and, more 
specifically, about the reading abilities of our nation’s students has increased because 
recent NAEP results appear to indicate that many students of all ages have difficulty 
reading thoughtfully. 14 

The NAEP Reading Framework underlying both the 1992 and 1994 assessments 
views reading as a dynamic, complex interaction between and among the reader, the text, 
and the context of the reading experience. Readers, for example, bring to the reading 
process their prior knowledge about a topic, their reasons for reading, their individual 
reading skills and strategies, and their understanding of differences in text structures. 15 

The texts used in the NAEP reading assessment are representative of common 
reading demands. Because reading performance varies in response to texts and contexts, 
the NAEP assessment measured students’ abilities to read different types of materials 
for different purposes. The texts were selected from naturally-occurring sources that are 
typically available to children in and out of school. Students in grade 4 were asked to 
respond to literary and informational texts, corresponding with the two purposes for 
reading assessed at grade 4 — reading for literary experience and reading to gain 
information. 



14 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993); Ina V.S. Mullis, John A. Dossey, Jay R. 
Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. NAEP 1992 Trends in Academic 
Progress. (Washington, DC: National Center for Education Statistics, 1994). 

15 J. A. Langer. “The Process of Understanding: Reading for Literary and Informational Purposes,” in Research in the 
Teaching of English, 24. (1990). pp. 229-260; NAEP Reading Consensus Project. Reading Framework for the 1992 
and 1994 National Assessment of Educational Progress. (Washington, DC: National Assessment Governing Board, 
U.S. Department of Education, 1994). 
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Reading for literary experience typically involves the reader in vicarious 
experiences through the story’s characters or considerations of how the author explores 
human events. Literary texts include short stories, poems, and folktales that engage the 
reader in a variety of ways, not the least of which is reading for fun. Reading to gain 
information may involve seeking to learn about a topic or to search for specific 
information. Informational texts include selections from textbooks, magazines, 
encyclopedias, and other written sources whose purpose is to increase the reader’s 
knowledge. Differences between narrative and informational text typically require 
students to use different skills and strategies. 

In addition to having fourth graders demonstrate their ability to read for two 
different purposes, the assessment asked students to build, extend, and examine meaning 
from four stances or types of interactions with the text. 

Initial Understanding 

Students are asked to provide the overall or general meaning of the 
selection. This includes first impressions, main points, or themes. 

Developing an Interpretation 

Students are asked to extend the ideas in the text by making inferences 
and connections. This includes making connections between cause and 
effect, analyzing the motives of characters, and drawing conclusions. 

Personal Response 

Students are asked to make explicit connections between the ideas in the 
text and their own background knowledge and experiences. This 
includes comparing story characters with themselves or people they 
know, or indicating whether they found a passage useful or interesting. 

Critical Stance 

Students are asked to consider the text objectively. This includes 
identifying how the author crafted a text with stylistic devices such as 
mood and tone. 

These stances are not considered hierarchical or completely independent of each 
other. Rather, they are viewed as recursive processes that take place throughout reading 
and represent different dimensions of the reader’s understanding. They provide a frame 
for generating assessment questions and considering student performance at all levels. 
All students at all levels should be able to respond to reading selections from all of these 
stances. What varies with students’ developmental and proficiency levels is the amount 
of prompting or support needed to elicit their responses, the complexity of the texts to 
which they can respond, and the sophistication of their answers. 

This chapter describes the reading proficiency of Washington’s public school 
fourth graders in 1994 and the comparative results of their regional and national 
counterparts. 
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Table 1.1 shows the distribution of reading proficiency of fourth-grade students 
attending public schools in Washington, the West region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Washington on the NAEP reading scale was 213. This average was 
not significantly different from that of students across the nation 
(212). 16 The lowest performing 10 percent of public school fourth 
graders in Washington had proficiencies at or below 161 while the top 
10 percent had proficiencies at or above 259. In public schools across 
the nation, the lowest performing 10 percent of fourth graders had 
proficiencies at or below 156; the top performing 10 percent of students 
had proficiencies at or above 261. 
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TABLE 1.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample, in comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



16 Differences reported as significant are statistically jdifferent at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



3 ? 



31 



Washington 



Proficiency According to Purpose for Reading 

As previously indicated, the questions in the 1994 Trial State Assessment Program 
covered two purposes for reading at grade 4 — reading for literary experience and 
reading to gain information. Table 1.2 provides results for Washington, the West region, 
and the nation according to each reading purpose. 

1994, Public School Students 

The proficiency of public school students in Washington in reading for 
literary experience (216) was not significantly different from that of 
students across the nation (214). Similarly, in reading to gain 
information, the proficiency of public school students in Washington 

(209) did not differ significantly from that of students across the nation 

( 210 ) . 
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Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). 
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CHAPTER 2 



Reading Proficiency of Fourth-Grade 
Students by Subpopulations 

The overall reading proficiency of public school students across the country 
presented in the previous chapter provides a global view of the state of reading 
performance. However, it is also important to look more closely at the performance of 
subgroups and to consider how different groups of children are progressing in reading. 
This information can provide educators, policy makers, and concerned citizens with 
important knowledge about how well students from different backgrounds and with 
different experiences are developing as readers. 

The 1994 Trial State Assessment Program provides additional information about 
the reading proficiency of important subpopulations by reporting on the performance of 
various subgroups of the public school student population defined by race/ethnicity, type 
of location, parents’ education level, and gender. 

Race/Ethnicity 

The 1994 Trial State Assessment Program results for different racial/ethnic groups 
can be compared when the number of schools and students in a racial/ethnic group is 
of sufficient size to be reliably reported. (See Appendix A for details.) Table 2.1 
presents reading proficiency results for White, Black, Hispanic, Asian, Pacific Islander, 
and American Indian fourth-grade public school students from Washington. 

1994, Public School Students 

As shown in Table 2.1, the average reading proficiency of White 
students in Washington public schools was higher than that of Black and 
Hispanic students but was not significantly different from that of Asian, 

Pacific Islander, or American Indian students. 
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TABLE 2.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Race/Ethnicity 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Type of Location 

Table 2.2 presents the reading proficiency results for fourth-grade students 
attending public schools in central cities, urban fringe/large towns, and rural areas/small 
towns. 



1994, Public School Students 

The results indicate that the average reading proficiency of Washington 
students attending public schools in central cities was not significantly 
different from that of students in urban fringe/large towns and rural 
areas/small towns. 
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TABLE 2.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Type of Location 
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School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Parents’ Education Level 

Previous NAEP findings have shown that students who report their parents are 
better educated tend to have higher reading proficiency* 17 Table 2.3 shows the results 
for fourth-grade public school students reporting that at least one parent graduated from 
college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, or they did not 
know their parents’ education level. Note that a substantial percentage of fourth graders 
indicated that they did not know their parents’ education level. Furthermore, research 
suggests that some fourth graders’ reports on parents’ education level are almost 
certainly not accurate descriptions of their parents’ actual education levels. 18 Such 
considerations should be kept in mind when interpreting fourth grade proficiency results 
for different parental education levels. 

1994, Public School Students 

As shown in Table 2.3, public school students in Washington reporting 
that at least one parent graduated from college demonstrated an average 
reading proficiency which was higher than that of students who reported 
that at least one parent had some education after high school, at least 
one parent graduated from high school, neither parent graduated from 
high school, or they did not know their parents’ education level. 
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TABLE 2.3 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Parents’ Level of Education 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 
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1994 Washington 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993.) 

18 

E. Dianne Looker. “Accuracy of Proxy Reports of Parental Status Characteristics,” in Sociology of Education, 62(4). 
(1989). pp. 257-276. 
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Gender 

In general, NAEP reading assessment results for males and females support 
numerous studies that have revealed gender differences favoring females in reading. 19 
As shown in Table 2.4, the 1994 Trial State Assessment Program results for Washington 
are consistent with those general findings. 

1994, Public School Students 

In public schools in Washington, girls exhibited an average reading 
proficiency which was higher than that of boys. 
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TABLE 2.4 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Gender 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



Proficiency According to Purpose for Reading 

Table 2.5 provides a summary of results according to each of the two purposes 
for reading by race/ethnicity, type of location, parents’ education level, and gender for 
public school students. 




19 Ian Plewis. “Pupils’ Progress in Reading and Mathematics During Primary School: Associations with Ethnic Group 
and Sex,” in Educational Researcher, 33. (1991). pp. 133-140; Gita Z. Wilder and Kristin Powell, Sex Differences in 
Test Performance: A Survey of the Literature . (New York: College Entrance Examination Board, 1989). 
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TABLE 2.5 

Fourth-Grade Public School Students’ Average 
Reading Proficiency According to Purpose for Reading 
by Subpopulation 





Reading for Literary Experience 


Reading to Gain Information 
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PARENTS’ EDUCATION 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP “purpose for reading 1 ' scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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PART TWO 



Reading Achievement Levels 

W hile providing information about what students can do in reading is essential 
for understanding the current state of reading performance, it is also important to 
determine whether students’ present performance is adequate. Knowing what students 
can do is made even more relevant by also looking at what students should be able to 
do. For that reason, the National Assessment Governing Board (NAGB) has provided 
NAEP with achievement levels in reading that set standards for performance in reading 
at grades 4, 8, and 12. 

This report presents data using the student achievement levels as authorized by the 
NAEP legislation and adopted by the National Assessment Governing Board 
(NAGB). 20 The achievement levels are based on collective judgments, gathered from 
a broadly representative panel of teachers, education specialists, and members of the 
general public, about what students should know and be able to do relative to a body 
of content reflected in the NAEP assessment frameworks. For reporting purposes, the 
achievement level cut scores are placed on the traditional NAEP scale. For each grade, 
the results divide the scale into four ranges — Basic , Proficient , and Advanced , as well 
as the region below Basic . 

Initiated in 1990, the levels have been used to report the national and state results 
in mathematics in 1990 and 1992, as well as in reading in 1992 and 1994. The reading 
achievement levels were developed by American College Testing (ACT) under contract 
with NAGB. While setting student achievement levels on the National Assessment is 
relatively new and developing, the achievement levels are consistent with recent 
education reform efforts. Some state and local jurisdictions are also developing 
standards and reporting their test results using them. 21 



20 P.L. 103-382. Improving America’s Schools Act of 1994. 

21 States such as Kentucky, Maryland, Colorado, Connecticut, and North Carolina all have standard-setting initiatives 
resulting in student achievement levels. 
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Despite the commitment to standards-based reporting of NAEP data, the transition 
is incomplete. There have been some critical reviews and congressionally mandated 
evaluations that cast doubt on the interpretability of achievement levels and also on the 
applicability of the underlying technical methodology used to develop them. These 
studies were conducted by the General Accounting Office (GAO) 22 and the National 
Academy of Education (NAE). 23 Their findings question, for example, the application 
of the Angoff method for large scale assessments like NAEP, given the significant 
modifications required to accommodate the complexity of the NAEP item structure and 
the multiple cutpoints. They conclude that discretion should be used in making 
particular inferences about what students at each level actually know and can do. In 
addition, there were concerns that the proportion of students at certain levels, but 
particularly at the advanced levels, may be underestimated. 

On the other hand, the Angoff procedure is the most widely documented, 
researched, and frequently used method in the standard-setting field. Many well-known 
experts support the use of a modified-Angoff method on NAEP. Several critics of the 
NAE studies, 24 for example, have reaffirmed the integrity of the process employed by 
the Board and have concluded that the weight of the empirical evidence presented does 
not support the NAE’s conclusions about achievement levels or the use of the 
modified-Angoff process. In addition, the Council of Chief State School Officers’ 
advisory panel of state assessment directors, fully aware of the NAE’s conclusions, 
supported the use of the achievement levels to report the 1994 reading results. 25 

Taken together, the results of the various studies suggest the need for further 
research and development. To that end, ACT, the NAGB contractor, recently conducted 
a study in anticipation of the 1994 NAEP reading reports. The study sought to examine 
the congruence between the reading assessment framework and the descriptions of 
reading performance embodied in the levels. 26 Two different methodologies were used: 
(1) evaluation of the achievement level descriptions via statistical item mapping, and (2) 
evaluation of the achievement level descriptions via judgmental item mapping. It was 
the consensus of the participants that the reading achievement level descriptions were, 
in general, consistent with the framework and the 1994 NAEP reading assessment 
results. However, minor modifications were suggested by the study panelists. These 
modifications were incorporated into the 1994 achievement level descriptions. 



22 General Accounting Office. Educational Achievement Standards: NAGB’ s Approach Yields Misleading 
Interpretations. (Washington, DC, 1993). 

23 

National Academy of Education. Setting Performance Standards for Student Achievement. (Stanford, CA: National 
Academy of Education, 1993). 

24 

American College Testing. Technical Report on Setting Achievement Levels on the 1992 National Assessment of 
Educational Progress in Mathematics, Reading, and Writing . (Washington, DC: National Assessment Governing 
Board, 1993); G. Cizak. Reactions to the National Academy of Education Report. (Washington, DC: National 
Assessment Governing Board. 1993); M. Kane. Comments on the NAE Evaluation of the NAGB Achievement Levels. 
(Washington, DC: National Assessment Governing Board, 1993). 

Education Information Advisory Committee of the Council of Chief State School Officers. A Resolution of the 
Education Information Advisory Committee. (Alexandria, VA, 1994). 

American College Testing. Technical Report on the 1992 NAEP Reading Re-visit Study. (Iowa City, IA: American 
College Testing, 1995). 
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It should be noted that the ACT study did not address the applicability of the 
modified- Angoff procedure for the 1994 reading assessment. Nor did it focus on the 
reasonableness of actual achievement level cut scores. However, NAGB continues to 
explore new and innovative methodologies for standard setting for NAEP. In addition, 
proceedings from a standard-setting conference held in the fall of 1994, jointly sponsored 
by NCES. and NAGB, are due to be released in the fall of 1995. Given the array of 
nationally known experts in attendance, the findings will undoubtedly provide additional 
insight into this issue. 

In sum, the student achievement levels in this report have been developed carefully 
and responsibly, and have been subject to refinements and revisions in procedures as 
new technologies have become available. However, standards-based reporting for NAEP 
data is still in transition. The NAEP legislation states that the student achievement levels 
shall be . . developed through a national consensus approach . . . used on a 
developmental basis, . . . and updated as appropriate.” It requires that their 
developmental status be clearly stated in NAEP reports. Upon review of the available 
information, the Commissioner of NCES has judged that the achievement levels are in 
a developmental status. However, the Commissioner and the Governing Board also 
believe that the achievement levels are useful and valuable in reporting on the 
educational achievement of American students. 

Part Two of this report focuses on results of the 1994 Trial State Assessment 
Program in terms of the NAGB achievement levels. Chapter 3 provides an overview 
of the achievement level descriptors. In addition, the percentages of public school 
students in Washington, the West region, and across the nation who performed at or 
above each of the achievement levels in 1994 are presented. Chapter 4 expands on these 
results by presenting achievement level data for subgroups — race/ethnicity, type of 
location, level of parents’ education, and gender. 
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CHAPTER 3 



Students’ Reading Achievement 



The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). As a result, students’ reading proficiencies presented in the previous 
section can be viewed in the context of established goals for performance. This report 
next presents results based on the National Assessment Governing Board’s goals for 
students’ achievement on the NAEP reading scale. 27 

Achievement goals are determined through collective judgments about how 
students should perform. These judgments are associated with specific points on the 
NAEP scale that serve to identify boundaries between levels of achievement for each 
grade — Basic, Proficient, and Advanced. Performance at the Basic level denotes partial 
mastery of the knowledge and skills that are fundamental for proficient work. The 
central level, called Proficient, represents solid academic performance. Students 
reaching this level demonstrate competency over challenging subject matter. 
Performance at the Advanced level signifies superior performance beyond proficient 
grade-level mastery. In this report, the proportion of students attaining the three 
achievement levels is presented for the 1994 assessment. 

Definitions of the three levels of reading achievement are given in Figure 3.1. 
Examples of questions at the achievement levels are also provided. The reading 
passages that accompany these questions can be found in Appendix B. It should be 
noted that constructed-response questions occur at all levels of reading achievement. 



Appendix C briefly describes the process of gathering expert judgments about Basic, Proficient, and Advanced 
performance — as defined by NAGB policy — on each reading item, combining the various judgments on the various 
items and mapping them onto the scale, and setting the scale score cutpoints for reporting purposes based on these 
levels. 
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FIGURE 3.1 

Levels of Reading Achievement at Grade 4 

The following achievement level descriptions focus on the interaction of the 
reader, the text, and the context. They provide some specific examples of reading 
behaviors that should be familiar to most readers of this document. The specific 
examples are not inclusive; their purpose is to help clarify and differentiate what readers 
performing at each achievement level should be able to do. While a number of other 
reading achievement indicators exist at every level, space and efficiency preclude an 
exhaustive listing. The achievement levels are cumulative from Basic to Proficient to 
Advanced. One level builds on the previous levels such that knowledge at the Proficient 
level presumes mastery of the Basic level, and knowledge at the Advanced level 
presumes mastery of both the Basic and Proficient levels. 
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Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading texts 
appropriate for fourth graders, they should be able to make relatively obvious 
connections between the text and their own experiences and extend the ideas in 
the text by making simple inferences. 



For example, when reading literary text, Basic-level students should be able to tell what the story is generally 
about — providing details to support their understanding — and be able to connect aspects of the stories to their own 
experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas from the text 
to their background knowledge and experiences. 




Fourth-grade students performing at the Proficient level should be able to 
demonstrate an overall understanding of the text, providing inferential as well as 
literal information. When reading text appropriate to fourth grade, they should be 
able to extend the ideas in the text by making inferences, drawing conclusions, and 
making connections to their own experiences. The connection between the text 
and what the student infers should be clear. 



Specifically, when reading literary text. Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text. Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, recognize 
relationships such as cause and effect or similarities and differences, and identify the meaning of the selection’s key 
concepts. 




Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness of 
how authors compose and use literary devices. When reading text appropriate to 
fourth grade, they should be able to judge texts critically and, in general, give 
thorough answers that indicate careful thought. 



Specifically, when reading literary text. Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the ideas 
suggested by the text. They should be able to identify literary devices such as figurative language. 

When reading informational text. Advanced-level fourth graders should be able to explain the author’s intent 
by using supporting material from the text. They should be able to make critical judgments of the text (including its form 
and content) and explain their judgments clearly. 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



The following questions were selected as examples of the types of questions that 
students at each of the three achievement levels can respond to effectively. The example 
questions were selected from the 1992 or 1994 NAEP reading assessments. These 
questions are based on the stories “Sybil Sounds the Alarm” and “Hungry Spider and 
the Turtle,” which are shown in their entirety in Appendix B. “Sybil Sounds the Alarm” 
is a fictional account of a historical event that describes the courage of a young colonial 
girl in riding her horse to warn of the approaching British army. “Hungry Spider and 
the Turtle” is a fable that presents a humorous portrayal of two characters and the jokes 
they play on each other. Both stories were used to assess reading for literary experience. 

For the multiple-choice questions, the correct answer is marked with an asterisk. 
For the constructed-response questions, a description of acceptable answers is provided. 
Also shown are the national overall percent correct and the percent correct for the 
students performing within the interval of the indicated level. For example, students 
with an average reading proficiency in the range 208-237 are in the Basic interval', at 
or above the cutpoint for the Basic level and below the cutpoint for the Proficient level. 

Samples of student responses to these and other constructed-response questions in 
the NAEP reading assessment appear in the Reading Assessment Redesigned report 
which provides an in-depth look at the assessment materials and tasks. Also, a 
presentation of sample student responses can be found in the 1994 NAEP Reading Report 
Card. 
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Sybil Sounds the Alarm 


Sybil’s father thought that she 

A. was obedient but forgetful 
* B. was courageous and a good rider 

C. could lead the troops against the British 

D. could easily become angry 


1992 Overall Percentage 


Correct 


4 \ 1992 Conditional Perc^ttilge Correct - | 

* i 


Nation 71 (1.4) 


Nation 75 (2.4) 



28 J.A. Langer, J.R. Campbell, S.B. Neuman, I.V.S. Mullis, H.R. Persky, and P.L. Donahue. Reading Assessment 
Redesigned. (Washington, DC: National Center for Education Statistics, 1995). 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



1994 Trial State Assessment 















Hungry Spider and the Turtle 



Who do you think would make a better friend, 
Spider or Turtle? Explain why. 



Acceptable responses indicated which character would make a better friend 
and provided appropriate evidence from the story in support of the 
selection. 



m .994 ;pver 



flit for Basic Interval ! 



Nation 


62 (1.4) 


Nation 


68 (2.3) 






Sybil Sounds the Alarm 


The information about the statue and stamp helps 
to show that 




* A. people today recognize and respect Sybil’s bravery 

B. people were surprised that George Washington honored her 

C. the author included minor details 

D. heroes are honored more now than they were then 


1 992 Overall Percentage Correct 


1992 Conditional Percentage Correct 
||§| § §§ | for Proficient Interval 1 ; 


Nation 


62(1.5) 


Nation 


87 (3.4) 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 
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Hungry Spider and the Turtle 


What do Turtle’s actions at Spider’s house te 
you about Turtle? 


;11 

is consistent 
of the story. 










Acceptable responses provided a description of Turtle that : 
with the traits portrayed by the character in a specific part < 


2 1 1994 Overall Percentage Acceptable 2 ; 


1994 Conditional Percentage Acd 

||gt ’■ ;||ii j . - s; 


Utable 


Nation 


41 (1.4) 


Nation 


64 (3.0) 
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Sybil Sounds the Alarm 



How does the author show the excitement and 
danger of Sybil’s ride? 



Acceptable responses described a specific element of the author’s portrayal 
of Sybil that contributed to the story’s atmosphere and tone. 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 
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Example Question 



Hungry Spider and the Turtle 



Think about Spider and Turtle in the story. 
Pick someone you know, have read about, 
or have seen in the movies or on television 
and explain how that person is like either 
Spider or Turtle. 



Responses that were rated as Essential or better demonstrated adequate 
understanding of the character of Spider or Turtle by providing any 
story-supported character trait and relating or linking that trait to a real 
world person or character. 












Nation 
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1994 Conditional Percentage Essential 
or Better for Advanced Interval 



Nation 



73 (8.6) 



53 



48 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Washington 



Table 3.1 provides the percentage of fourth-grade public school students at or 
above each achievement level, as well as the percentage of students below the Basic 
level. 



1994, Public School Students 

The percentage of public school students in Washington who were at 
or above the Proficient level (27 percent) did not differ significantly 
from that of students across the nation (28 percent). 
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TABLE 3.1 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement 



1994 Trial State Assessment 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 


1994 Public 

Washington 

West 

Nation 


Lr ; >■ ‘ ; : Percentage ; 

:*A> ifilSI H |®fl#IS 8 illlii S* liH® 1 IP 

- '27(12) ^ : f « <-69,(1^).,; ;■ -4V( 1.6)'; 

& .4 7(0.8) . ,,, , . . , 28 ( 2.0) i , •! • , - 59 ( 2 £) | ; ; >. 5 >41; < 22) j | 

' 7, { 0.7) : : ,28(15) “ 59(1.1)/; ' ;; _41< i.iy 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Many students in Washington were unable to meet the Proficient achievement 
level that represents solid academic performance in reading. Educators and policy 
makers will need to look to many sources of information and opinion for explanations 
of these levels of achievement. Among the possible explanations, several factors should 
not be overlooked. First, students may not be learning enough in school to reach the 
achievement levels. In 1983, the National Commission on Excellence in Education 
warned that “the educational foundations of our society are being eroded by a rising tide 
of mediocrity that threatens our very future.” 29 In 1990, the president and the governors 
committed the nation to six goals for education, the third of which called for American 
students to “leave grades four, eight and twelve having demonstrated competency in 
challenging subject matter.” 30 Many political leaders of this nation continue to express 
dissatisfaction with the performance of American students. These NAEP findings 
confirm that a great many American students are not yet performing at high levels. 

Second, some students may not be reaching the higher achievement levels because 
schools may not be teaching the elements of reading that are included on the NAEP 
assessment, and because the assessment may not be covering some elements of reading 
included in the school curriculum. No assessment or test can cover all the different areas 
of reading that are taught in school. The content coverage of the NAEP reading 
assessment was set by a consensus approach. Teachers, curriculum specialists, subject 
matter specialists, local school administrators, parents, and members of the general 
public actively participated in deciding what are the most important elements of reading 
to be included in the assessment and for students to learn. 31 

Third, the Basic, Proficient, and Advanced achievement levels reflect high 
standards for the 1994 NAEP reading scale. The establishment of achievement levels 
depends on securing a set of informed judgments of expectations for student educational 
achievement and on summarizing the individual ratings into collective judgments. These 
expectations reflect the Board’s policy definitions, which require that students at the 
central, Proficient level demonstrate “competency over challenging subject matter.” The 
resulting standards are rigorous. 

As measures of performance, both average proficiency scores and percentages of 
students who score at or above the critical achievement levels on the NAEP scale 
provide a valuable overall depiction of students’ reading ability. 



29 

National Commission on Excellence in Education. A Nation at Risk. (Washington, DC: U.S. Department of 
Education, 1983). In 1988, then-Secretary Bennett reported that the “precipitous downward slide of previous decades 
has been arrested, and we have begun the long climb back to reasonable standards.” (p. 1 in American Education: 
Making it Work. (Washington, DC: U.S. Department of Education, 1988).). 

U.S. Department of Education. America 2000: An Education Strategy. (Washington, DC: U.S. Department of 
Education, 1991). 

NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress . (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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CHAPTER 4 



Reading Achievement of Fourth-Grade 
Students by Subpopulations 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 32 This chapter presents achievement level results for subgroups of public 
school students from Washington defined by race/ethnicity, type of location, level of 
parents’ education, and gender. 

Race/Ethnicity 

Table 4.1 provides the percentage of public school students at or above each of 
the three achievement levels and also the percentage below the Basic level for White, 
Black, Hispanic, Asian, Pacific Islander, and American Indian students. 

1994 ' y Public School Students 

In 1994, the percentage of White students in Washington who attained 
the Proficient level was greater than that of Black and Hispanic students 
but was not significantly different from that of Asian, Pacific Islander, 
or American Indian students. 



32 Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress . (Washington, DC: National Center for Education Statistics. 1994). 
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TABLE 4.1 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Race/Ethnicity 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



Percentage 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). ! Interpret with 
caution — the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample 
size is insufficient to permit a reliable estimate. 
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Type of Location 

Table 4.2 presents reading performance by achievement levels for fourth-grade 
students attending public schools in central cities, urban fringe/large towns, and rural 
areas/small towns. 



1994 , Public School Students 

In Washington, the percentage of students attending public schools in 
central cities who attained the Proficient level was not significantly 
different from that of students in urban fringe/large towns or rural 
areas/small towns. 
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TABLE 4.2 

Levels of F ourth-Grade Public School Students y 
Reading Achievement by Type of Location 



1994 Trial State Assessment 


At or Above 


At or Above 


At or Above 


Below 




Advanced 


Proficient 


Basic 


Basic 










Percentage 
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School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Parents’ Education Level 

Table 4.3 shows the reading achievement level results for fourth-grade public 
school students who reported that at least one parent graduated from college, at least 
one parent had some education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know their parents’ 
education level. 



1994 , Public School Students 

In Washington, the percentage of students reporting that at least one 
parent graduated from college who performed at or above the Proficient 
level was larger than that of students who reported that at least one 
parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, 
or they did not know their parents’ education level. 
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TABLE 4.3 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Parents’ Level of Education 



1994 Trial State Assessment 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



Percentage 



College graduate 
1994 Washington 
West 
Nation 

Some education after HS 
1994 Washington 
West 
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High school graduate 
1994 Washington 
West 
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High school non-graduate 
1994 Washington 
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I don’t know 
1994 Washington 
West 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Gender 

Table 4.4 provides the achievement level results by gender for fourth-grade public 
school students. 



1994, Public School Students 

The percentage of males in Washington public schools who attained the 
Proficient level was smaller than that of females. 
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TABLE 4.4 

Levels of Fourth-Grade Public School Students 9 
Reading Achievement by Gender 



1994 Trial State Assessment 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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PART THREE 



Finding a Context for Understanding 
Students’ Reading Proficiency in Public 
Schools 

Information on the reading proficiency of students in Washington can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment Program, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on instruction, 
programs, and policies. The student, teacher, and school data help to describe some of 
the current practices in reading education, to illuminate some of the factors that appear 
to be related to fourth-grade public school students’ reading proficiency, and to provide 
an educational context for understanding information on student achievement. 

It is important to note that the NAEP data cannot establish cause-and-effect links 
between various contextual factors and students’ reading proficiency. However, the 
results do provide information about important relationships between the contextual 
factors and proficiency. Through the questionnaires administered to students, teachers, 
and principals, NAEP is able to provide a broad picture of educational practices 
prevalent in American schools and classrooms. 

Part Three consists of four chapters. Chapter 5 discusses policies and practices 
related to reading. Chapter 6 focuses on instructional approaches — how instruction is 
delivered. Chapter 7 provides information about teachers, and Chapter 8 examines 
students’ home support for literacy. 
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CHAPTER 5 



Policies and Practices Related to Reading 

This chapter focuses on curricular and instructional content issues in Washington 
public schools and their relationship to students’ reading proficiency. Table 5.1 
provides a profile of the reading policies and practices in the public schools with fourth 
grades in Washington. Some of the selected results obtained from teacher and school 
questionnaires reveal: 

• According to the public school administrators in Washington in 1994, 

65 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was 
smaller than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 16 percent of the students 
in public schools in Washington were typically taught reading in a class 
that was grouped by reading ability. The prevalence of ability grouping 
was not significantly different* across the nation (22 percent). 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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TABLE 5.1 

Reading Policies and Practices in Fourth-Grade Public 
Schools 



1994 Trial State Assessment 



Washington 



West 



Nation 




Percentage of students in public schools that identified 
reading as a priority in schoolwide goals and objectives, 
instruction, workshops, etc. 

1994 

Percentage of students in public schools who are assigned 
to a reading class by their ability 
1994 

Percentage of students in public schools who stay with the 
same teacher for all academic subjects 
1994 

Percentage of students in public schools who remain with 
one teacher for most subjects but may have a different 
teacher for one or two subjects 
1994 

Percentage of students in public schools in which a reading 
curriculum specialist is available to help or advise 
1994 

Percentage of students in public schools that use parents 
as aides in classrooms 
1994 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Time for Instructional Activities 

To begin to place students’ reading proficiency in context, it is useful to examine 
the extent to which fourth-grade students’ reading teachers in Washington are spending 
their time on instructional activities. Teachers of the assessed students were asked to 
report on the amount of time they spent with each class for reading instruction on a 
typical day. Table 5.2 shows the results for public school students. 33 

• In 1994, the percentage of students in Washington who had reading 
teachers who spent 60 minutes providing reading instruction each day 
(43 percent) did not differ significantly from that across the nation 
(44 percent). 

• In Washington in 1994, average reading proficiency was similar for 
students regardless of how much time their reading teachers spent on 
reading instruction on a typical day. 
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TABLE 5.2 

Public School Teachers * Reports on Time Spent 
Teaching Reading 



1994 Trial Slate Assessment 


Washington 


West 


Nation 


About how much time do you spend for 
reading instruction on a typical day? 

45 minutes or less 
1994 

60 minutes 
1994 

90 minutes or more 
1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 



33 For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides 
a corresponding table presenting the results for the four subpopulations — race/ethnicity, type of location, parents’ 
education level, and gender. 
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Instructional Resources for Reading 

Teachers’ use of resources is obviously constrained by the availability of those 
resources. Thus, the assessed students’ teachers were asked about the extent to which 
they were able to obtain all of the instructional materials and other resources they 
needed. From Table 5.3: 

• In 1994, the percentage of fourth-grade students in public schools in 
Washington who were being taught by teachers who reported getting all 
of the resources they needed (8 percent) did not differ significantly from 
the corresponding percentage of students across the nation (9 percent). 

• Furthermore, in 1994, the percentage of public school students in 
Washington whose teachers got only some or none of the resources they 
needed (38 percent) did not differ significantly from that of students 
across the nation (35 percent). 

• In 1994, public school students in Washington whose teachers got all 
of the resources they needed had an average reading proficiency (212) 
which was not significantly different from that of students whose 
teachers got only some or none of the resources they needed (213). 
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TABLE 5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 



Washington 



West 



Nation 



Which of the following statements is true 
about how well your school system 
provides you with the instructional 
materials and other resources you need 
to teach your class? 

I get all the resources I need. 

1994 

I get most of the resources I need. 

1994 

I get some or none of the resources I need. 

1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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CHAPTER 6 



How Is Reading Instruction Delivered? 

Effective classroom instruction can help students become thoughtful readers. 34 
The instructional activities that students complete can also lead them to view reading in 
particular ways 35 and to focus their efforts on developing certain skills and strategies. 
To provide information about how instruction is delivered in Washington, fourth-grade 
students participating in the Trial State Assessment Program and their reading teachers 
were asked to report on the use of various teaching and learning activities in their 
reading classrooms. 

Instructional Materials for Reading 

Basal reading programs are a traditional part of reading instruction in this country. 
They typically include a compilation of reading passages and exercises, as well as 
ancillary materials, such as workbooks and tests. These types of programs account for 
at least two-thirds of all expenditures for reading instruction and are used in more than 
95 percent of all school districts through grade 6. 36 However, other types of reading 
programs may utilize trade books, such as story or informational books, that are not 
necessarily published for the sole purpose of reading instruction. When students 
encounter a variety of texts, they expand their general understanding of language, as 
well as their understanding of text and its underlying structures. 37 To provide 
information about instructional materials used for fourth-grade classes, students’ reading 
teachers were asked to report about the type of materials that formed the core of their 
reading program. Table 6.1 provides the results. 



34 A.P. Sweet. Transforming Ideas for Teaching and Learning to Read (Washington, DC: Office of Educational 
Research and Improvement. 1993). 

35 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research , 61. (1991). pp. 239-264. 

36 Jeanne S. Chall and James R. Squire. “The Publishing Industry and Textbooks," in R. Barr, M. Kamil, P. Mosenthal, 
and P.D. Pearson, Eds., Handbook of Reading Research, Volume II. (New York, NY: Longman, 1991). 

37 V. J. Harris. “Literature-Based Approaches to Reading Instruction,” in Review of Research in Education. (Washington, 
DC: American Educational Research Association, 1993). 
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According to Washington public school reading teachers, in 1994: 

• Students in Washington whose teachers used both basal and trade books 
demonstrated an average reading proficiency (215) which was higher 
than that of students whose teachers primarily used basal readers (202). 

• The proficiency of Washington students whose teachers used both basal 
and trade books (215) was not significantly different from that of 
students whose teachers primarily used trade books (216). 

• The proficiency of Washington students whose teachers primarily used 
trade books (216) was higher than that of students whose teachers 
primarily used basal readers (202). 
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TABLE 6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 


Washington 


West 


Nation 


What type of materials form the 
core of your reading program? 

Primarily basal 
1994 

Primarily trade books 
1994 

Both basal and trade books 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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Teachers were also asked about their use of specific types of resources that can 
add depth and variety to the reading program (Table 6.2). Some selected results for 
public school students reveal that, in 1994: 

• In Washington, 28 percent of the fourth-grade students had reading 
teachers who used children’s newspapers and/or magazines at least once 
a week. This percentage was not significantly different from that for the 
nation (30 percent). 

• The percentage of Washington students who had reading teachers who 
used reading kits at least once a week (18 percent) did not differ 
significantly from that for students in the nation (21 percent). 

• The percentage of students in Washington who had reading teachers who 
used computer software for reading instruction at least once a week 
(17 percent) was smaller than that for the nation (24 percent). 

• In Washington, 80 percent of the students had reading teachers who 
used a variety of books at least once a week. This figure was not 
significantly different from that for students across the nation 
(75 percent). 

• The percentage of students in Washington who had reading teachers who 
used materials from other subject areas at least once a week (70 percent) 
did not differ significantly from that for the nation (69 percent). 



Instructional Activities 

Teachers can nurture students’ developing reading ability by providing 
instructional activities that prepare students for a wide variety of specific reading 
tasks. 38 Effective activities support students’ understanding of the text being read and 
model the ways in which students can control the process of building meaning when 
reading on their own. 39 To provide information about the instructional activities in 
which fourth-grade students are engaged, the students participating in the Trial State 
Assessment Program and their reading teachers were asked to report on the frequency 
with which the teachers asked the students to do a variety of activities. The students’ 
and teachers’ responses are presented in the three following sections — workbooks, 
worksheets, and writing; discussions and group activities; and time to read. The 
students’ and teachers’ responses sometimes reflect different perceptions of the 
frequency of some activities. 



38 S.G. Paris. ‘Teaching Children to Guide Their Reading and Learning,” in Taffy E. Raphael, Ed., The Contexts of 
School-Based Literacy. (New York, NY: Random House, 1984). pp. 115-130. 

39 A.P. Sweet. Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 
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TABLE 6.2 

Public School Teachers ’ Reports on Resources for 
Reading Instruction 



1994 Trial State Assessment 


How often do you 


use the following 


resources to teach reading? 


Children’s newspapers and/or magazines 


At least once a week 


1994 


Once or twice a month 


1994 


Never or hardly ever 


1994 


Reading kits 




At least once a week 


1994 


Once or twice a month 


1994 


Never or hardly ever 


1994 


Computer software for reading instruction 


At least once a week 


1994 


Once or twice a month 


1994 


Never or hardly ever 


1994 


A variety of books (e.g., i 


novels, collections 


of poetry, nonfiction) 




At least once a week 


1994 


Once or twice a month 


1994 


Never or hardly ever 


1994 


Materials from other subject areas 


At least once a week 
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Once or twice a month 


1994 


Never or hardly ever 


1994 
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me iN/\c.r reading scale ranges rrom u to duu. me standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 




66 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Washington 



Workbooks, Worksheets, and Writing 

Some educators and researchers have suggested that children spend a 
disproportionate amount of time completing workbook tasks rather than receiving 
reading instruction or actively constructing their own understandings. 40 Analyses of 
workbook and worksheet activities reveal that many of these tasks require only a 
perfunctory level of reading. 41 Although we do not know what specific activities 
constitute time spent on workbooks and worksheets, such tasks rarely require students 
to engage in any extended writing. Writing activities have been found to incite 
children’s interest and involvement in learning about language and to enhance their 
reading comprehension. 42 To examine the use of workbooks, worksheets, and the 
reading/writing connection, students and their reading teachers were asked about the 
frequency with which teachers asked students to work in a reading workbook or on a 
worksheet or to write about something they had read. Table 6.3 provides these results. 

In 1994, according to the fourth-grade public school students in Washington: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (43 percent) was greater 
than the percentage of students who were asked to write about 
something they have read almost every day (21 percent). 

• Students who were asked to work' in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (215) which was not significantly different from that of 
students who did this activity less than weekly (212). 

• The average reading proficiency of students who were asked to write 
about something they have read almost every day (209) was not 
significantly different from that of students who were asked to do this 
less than weekly (213). 

And, according to their reading teachers: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (17 percent) was smaller 
than the percentage of students who were asked to write about 
something they have read almost every day (31 percent). 



40 P.D. Pearson, L.R. Roehler, J.A. Dole, and G.G. Duffy. “Developing Expertise in Reading Comprehension,” in S.J. 
Samuels and A.E. Farstrup, Eds., What Research Has to Say About Reading Instruction . (Newark, DE: International 
Reading Association, 1992); R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of 
Readers ; The Report of the Commission on Reading. (U.S. Department of Education: The National Institute of 
Education, 1985). 

41 J.R. Campbell, B.A. Kapinus, and A.S. Beatty. Interviewing Children About Their Literacy Experiences. (Washington, 
DC: National Center for Education Statistics, Government Printing Office, 1995); J. Osborn. “Workbooks: Counting, 
Matching, and Judging,” in J. Osborn, P.T. Wilson, and R.C. Anderson Eds., Reading Education : Foundations for a 
Literate America. (Lexington, M A: Lexington Books, 1985). 

42 S.D. Miller, T. Adkins, and M.L. Hooper. “Why Teachers Select Specific Literacy Assignments and Students’ 
Reactions to Them,” in Journal of Reading Behavior, 25(1), 69-93. 1993; D.C. Simmons, E.J. Kameeuni, S. Dickson, 
D. Chard, B. Gunn, and S. Baker. “Integrating Narrative Reading Comprehension and Writing Instruction for All 
Learners,” in Multidimensional Aspects of Literacy Research, Theory, and Practice. (Chicago, IL: National Reading 
Conference, 1994). 
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• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (212) which was not significantly different from that of 
students who did this activity less than weekly (216). 

• The reading proficiency of students who were asked to write about 
something they have read almost every day (216) was not significantly 
different from* that of students who were asked to do this less than 
weekly (208). 
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TABLE 6.3 

Public School Teachers 9 and Students 9 Reports on 
Workbooks , Worksheets , and Writing 



1994 Tnal State Assessment 



Washington 



Teacher Student 



West 



Teacher Student 



Nation 



Teacher Student 



How often do you (does 
your teacher) do each of 
the folio wing as a part of 
reading instruction? 
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workbook or on a worksheet 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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Discussion and Group Activities 

Discussion-related activities are an important part of classroom learning, because 
they provide opportunities for students to ask questions about things they do not 
understand or want to know more about. A lack of emphasis on group work or the 
sharing of different interpretations limits opportunities students have for discovering that 
their reactions or interpretations may not be the only ones justified by the text. 43 
Furthermore, working in groups and discussing reading provide opportunities for 
students to develop language and communication skills that are necessary for literacy 
learning. 

To examine the prevalence of discussion-related activities, students and their 
reading teachers were asked about how frequently the students discussed new or difficult 
vocabulary, talked with each other about what they have read, or did a group activity 
or project about what they have read (Table 6.4). 

In 1994, according to the fourth-grade students in public schools: 

• Less than one third of the students in Washington (29 percent) were 
asked to discuss new or difficult vocabulary almost every day. This 
percentage was somewhat smaller than that of students across the nation 
(32 percent). 

• The percentage of students in Washington who were asked to talk with 
each other almost every day about what they have read (16 percent) 
was not significantly different from that of students across the nation 
(17 percent). 

• Less than one fifth of the students in Washington (14 percent) were 
asked to do a group activity or project about what they have read almost 
every day. This figure was not significantly different from that of 
students across the nation, where 15 percent of the students were asked 
to do this. 

And, according to their reading teachers: 

• In Washington, 55 percent of the students were asked to discuss new 
or difficult vocabulary almost every day. This percentage did not differ 
significantly from* that of students across the nation (62 percent). 

• The percentage of students in Washington who were asked to talk with 
each other almost every day about what they have read (31 percent) 
was not significantly different from that of students across the nation, 
where 34 percent of the students were asked to do this activity almost 
every day. 

• A small percentage of the students in Washington (6 percent) were 
asked to do a group activity or project about what they have read almost 
every day. This figure was not significantly different from that of 
students across the nation (5 percent). 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 

43 J. Moffett and B. Wagner. “Student Centered Reading Activities,” in English Journal, 80. 1991. 
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TABLE 6.4 

Public School Teachers’ and Students’ Reports on the 
Frequency of Discussion and Group Activities 



1994 Trial Slaie Assessment 



Washington 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



How often do you (does 
your teacher) do each of 
the following as a part of 
reading instruction? 

Discuss new or difficult vocabulary 

Almost every day 1994 

At least once a week 1994 

Less than weekly 1994 

Ask students to talk with each other 
about what they have read 

Almost every day 1994 

At least once a week 1 994 

Less than weekly 1994 

Ask students to do a group activity 
or project about what they have read 

Almost every day 1994 

At least once a week 1994 

Less than weekly 1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Time to Read 

Independent reading continues to be a major contributor to reading fluency. 44 In 
contrast to completing workbook pages or computer drills, the reading of books provides 
practice in the whole act of reading. However, some studies have suggested that 
students may not be asked to read in school as frequently as is necessary to support 
literacy development. 45 

Both the fourth-grade students and their reading teachers were questioned about 
the frequency with which the teachers asked the students to read aloud or read silently, 
or gave the students time to read books of their own choosing. Table 6.5 provides this 
information. 

According to the fourth-grade public school students in 1994: 

• The percentage of students in Washington who were asked to read aloud 
almost every day (35 percent) was smaller than that of students across 
the nation who were asked to read aloud almost every day (45 percent). 

• About three quarters of the students (76 percent) were asked to read 
silently almost every day. This figure was larger than that for the nation 
(64 percent). 

• In Washington, 61 percent of the students were given time to read books 
of their own choosing almost every day. This percentage was larger 
than that of students nationwide (53 percent). 



And, according to their reading teachers: 

• Less than half of the students in Washington (47 percent) were asked 
to read aloud almost every day. This figure was smaller than that of 
students across the nation, where 57 percent of the students were asked 
to read aloud almost every day. 

• The percentage of students in Washington who were asked to read 
silently almost every day (83 percent) was greater than that of students 
across the nation (74 percent). 

• A large majority of the students in Washington (84 percent) were given 
time to read books of their own choosing almost every day. This was 
greater than the percentage of students across the nation (69 percent). 




I. Wilkinson, J.L. Wardrop, and R.C. Anderson. “Silent Reading Reconsidered: Reinterpreting Reading Instruction 
and Its Effects,” in American Educational Research Journal, 25(1). (1988). pp. 127-144; C.S. Huck. “Literacy and 
Literature,” in Language Arts, 69. (1992). pp. 520-526. 

R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985); M.A. Foertsch. 
Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 1992). 
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TABLE 6.5 

Public School Teachers’ and Students’ Reports on the 
Frequency of Reading in Class 



1994 Trial State Assessment 



Washington 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



How often do you (does 
your teacher) do each of 



the fot towing as a part of 
reading instruction? 


Ask students to read aloud 




Almost every day 


1994 


At least once a week 


1994 


Less than weekly 


1994 


Ask students to read silently 


Almost every day 


1994 


At least once a week 


1994 


Less than weekly 


1994 


Give students time to read books 
they have chosen themselves 


Almost every day 


1994 


At least once a week 


1994 


Less than weekly 


1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Reading and Use of Libraries 

Analysis of schools that have been successful in promoting independent reading 
suggests that one of the keys is ready access to books. 46 Libraries can be a major 
resource in developing students’ reading abilities because students can use them as quiet 
places to read as well as to check out books and to obtain reference information. 47 Thus, 
to examine library use, students’ reading teachers were asked about the frequency with 
which they sent or took their reading classes to the library and assigned students to read 
a book from the library. Table 6.6 provides the results from public school teachers’ 
reports about the frequency of sending fourth-grade students to the library. 

• In 1994, almost all of the students in Washington (95 percent) had 
reading teachers who sent or took the class to the library at least once 
a week. This percentage was larger than that of students in the nation 
whose teachers sent or took the class to the library with the same 
frequency (86 percent). 




TABLE 6.6 

Public School Teachers 9 Reports on Sending Students 
to the Library 



1994 Trial Slate Assessment 



Washington 



West 



Nation 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 



46 R.C. Anderson. E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

47 K.C. Lance, L. Welbom, and C. Hamilton-Pennel. The Impact of School Library Media Centers on Academic 
Achievement. (Castle Rock, CO: Hi Willow Research and Publishing, 1993). 
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Table 6.7 provides the results about public school teachers’ reports on the 
frequency of assigning students to read a book from the library. 

• In 1994, more than half of the fourth graders in Washington (56 percent) 
had reading teachers who assigned reading a book from the library at 
least once a week. The percentage of students whose teachers assigned 
reading library books this often was smaller across the nation 
(47 percent). 
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TABLE 6.7 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Trial Stale Assessment 


Washington 


West 


Nation 


How often do you assign 
students to read a book from 
the library? 

At least once a week 
1994 

Once or twice a month 

1994 

Never or hardly ever 

1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. 
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Assessing Progress in Reading 

Ten years ago, the authors of Becoming a Nation of Readers argued that 
standardized tests do not always provide a deep assessment of reading comprehension 
and should be supplemented with observations of reading fluency, critical analysis of 
lengthy reading selections, and measures of the amount of independent reading and 
writing done by children. 48 

Over the last decade, reforms in classroom assessment have been called for at 
numerous levels. Many educators have begun to utilize assessment methods that are 
more instructionally-relevant and performance based. 49 At the same time, policy makers 
and the interested public have called for educational assessments that measure the more 
integrative, complex abilities that are associated with advanced achievement. 50 

Fourth-grade students’ reading teachers were asked a series of questions to report 
on how often they used different types of assessment measures — including 
multiple-choice tests, longer extended constructed-response questions, and reading 
portfolios — to assess student progress in reading. The use of reading portfolios 51 is 
an emerging assessment technique that may not be widely used in many schools. From 
Table 6.8: 

♦ In 1994, a small percentage of the fourth-grade public school students 
in Washington (5 percent) were assessed with multiple-choice tests once 
or twice a week. This figure was smaller than that for the nation, where 
12 percent of the students were similarly assessed. 

♦ The percentage of students in Washington public schools in 1994 who 
were asked to write paragraphs about what they had read once or twice 
a week (31 percent) was smaller than that of students across the nation 
(39 percent). 

♦ In 1994, relatively few of the fourth graders in public schools in 
Washington (13 percent) were assessed by using reading portfolios once 
or twice a week. This percentage was not significantly different from 
that of students across the nation (15 percent). 



48 R.C. Anderson, E.H. Hiebert. J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

49 S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities. 
(Newark, DE: International Reading Association, 1994). 

50 G. Wiggins. “Assessment: Authenticity, Context, and Validity ” in Phi Delta Kappan. (November, 1993). pp. 
200-214. 

51 S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities. 
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TABLE 6.8 

Public School Teachers’ Reports on Assessing 
Progress in Reading 



1994 Trial State Assessment 



Washington 



West 



Nation 



How often do you use each of the 
following to assess student 
progress in reading? 

Multiple-choice tests 



Once or twice a week 


1994 


Once or twice a month 


1994 


Once or twice a year 


1994 


Never or hardly ever 


1994 



Paragraph length written responses 
about what students have read 



Once or twice a week 


1994 


Once or twice a month 


1994 


Once or twice a year 


1994 


Never or hardly ever 


1994 


Reading portfolios 

Once or twice a week 


1994 


Once or twice a month 


1994 


Once or twice a year 


1994 


Never or hardly ever 


1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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CHAPTER 7 



Who Is Teaching Reading to Fourth Graders? 

Preparation and Experience 

Many states have begun to raise teacher certification standards and strengthen 
teacher training programs. In curriculum areas requiring special attention and 
improvement, such as reading, it is particularly important to have well-qualified teachers. 
To provide information about the staff who are teaching reading to fourth-grade students, 
the Trial State Assessment Program gathered details on the educational backgrounds of 
the teachers of the assessed students. Table 7.1 summarizes fourth-grade public school 
teachers’ responses to questions concerning their academic preparation, certification, and 
their years of elementary or secondary teaching experience. In 1994: 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Washington (42 percent) was not significantly different from that for 
the nation (41 percent). 

• About three quarters of the students (78 percent) had reading teachers 
who had the highest level of teaching certification that is recognized by 
Washington. This was greater than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Washington, 27 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was greater than the percentage of students across 
the nation who were being taught by reading teachers with the same 
major (20 percent). 

• The percentage of students in Washington who were taught reading by 
teachers who had a graduate major in English, reading, and/or language 
arts (25 percent) was greater than that of students across the nation 
(13 percent). 

• The percentage of students who were being taught reading by teachers 
who have taught at either the elementary or secondary level for at least 
11 years (including part-time teaching) in Washington (64 percent) was 
not significantly different from that for students across the nation 
(67 percent). 
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TABLE 7.1 

Public School Teachers’ Reports on Their Fields of 
Study and Teaching Experience 



1994 Trial State Assessment 


Washington 


West 


Nation 


What is the highest academic degree you hold? 




percentage 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Professional Development 

Teachers were also asked about the amount of time they spent in staff development 
workshops or seminars dedicated to reading or the teaching of reading during the year 
immediately preceding the Trial State Assessment Program. From Table 7.2, in 1994: 

• In Washington, 28 percent of the fourth-grade public school students 
had reading teachers who spent at least 16 hours in staff development 
workshops or seminars dedicated to reading or the teaching of reading. 

This figure was lower than that for the nation (36 percent). 

• The percentage of students in Washington public schools whose reading 
teachers spent no time on staff development workshops or seminars in 
reading or the teaching of reading (18 percent) was higher than that of 
students across the nation (10 percent). 
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TABLE 7.2 

Public School Teachers’ Reports on Time Spent in 
Staff Development Workshops and Seminars 



1994 Trial State Assessment 


Washington 


West 


Nation 


During the last year, how much 
time in total have you spent in 
staff development workshops 
or seminars in reading or the 
teaching of reading? 

None 

1994 

One to 15 hours 
1994 

16 hours or more 

1994 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Finally, teachers were asked to report on whether they had training in specific 
aspects of reading during the past five years, either in college courses or through 
workshops. As indicated in Table 7.3, regarding fourth-grade public school students in 
1994: 



• In Washington, 74 percent of the students had reading teachers who 
reported that' they had training in teaching critical thinking skills. This 
was not significantly different from the figure for the nation, where 
78 percent of the students had teachers who reported having such 
training. 

• About three quarters of the students in Washington (79 percent) had 
reading teachers who reported that they had training in combining 
reading and writing. This percentage was smaller than that for students 
across the nation (89 percent). 

• About three quarters of the students in Washington (78 percent) had 
teachers who reported having training in the whole language approach 
to teaching reading. This percentage did not differ significantly from* 
that for the nation (85 percent). 

• In Washington, 56 percent of the students had teachers who reported 
that they had training in reading assessment. This figure was lower than 
that for students across the nation, where 67 percent of the students had 
teachers who had training in reading assessment. 




TABLE 7.3 

Public School Teachers’ Reports on Training in 
Specific Reading Areas 



1994 TnaJ State Assessment 


Washington 


West 


Nation 


During the past five years, have 
you ever had training in any of 
the following? 

Teaching critical thinking 
1994 

Combining reading and writing 
1994 

The whole language approach 
to teaching reading 
1994 

Reading assessment 
1994 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 




* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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CHAPTER 8 



Students’ Home Support for Literacy 

A multitude of home and attitudinal variables may affect students’ reading 
achievement. 52 In addition, good readers usually interact with a wide variety of 
materials on their own, and share their experiences with family and friends. 53 Thus, it 
is important to understand students’ attitudes toward reading, the extent to which 
students read on their own, and the degree of home support that is available for reading. 
To examine these factors, students participating in the Trial State Assessment Program 
were asked a series of questions about themselves, their parents or guardians, and home 
factors related to reading. 

Reading Outside of School 

Because of the increasing concern for students’ independent reading 
habits, 54 students participating in the Trial State Assessment Program were asked to 
report on how often they read for fun on their own time (Table 8.1). They also were 
asked about the number of books they have read on their own outside of school during 
the month preceding the assessment (Table 8.2), and how often they have taken books 
out of the school library or public library for their own enjoyment (Table 8.3). 



5 * J.T. Guthrie and V. Greaney. “Literacy Acts ” in R. Barr, M. Kamil, P. Mosenthal, and P.D. Pearson, Eds., Handbook 
of Reading Research: Volume II. (New York, NY: Longman, 1991). 

53 A.P. Sweet. Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 

54 L.G. Fielding, P.T. Wilson, and R.C. Anderson. “A New Focus on Free Reading: The Role of Trade Books in Reading 
and Instruction,” in T. Raphael and R. Reynolds, Eds., Contexts of Literacy. (New York: Longman, 1990). 
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The results are provided in Table 8.1 regarding how often fourth-grade public 
school students reported reading for fun on their own time. 

• In 1994, 48 percent of the students in Washington reported that they 
read for fun almost every day. This figure was somewhat higher than 
that for the nation (45 percent). 

• In Washington in 1994, the average reading proficiency of students who 
read for fun almost every day (222) was higher than that of students 
who reported that they read for fun once or twice a month or less (200). 



THE NATION'S 
REPORT livapn 
CARD ~ 



1994 Trial State Assessment 



ivaep 






TABLE 8.1 

Public School Students’ Reports on the Frequency of 
Reading for Fun 





Washington West Nation 


How often do you read for fun 
on your own time? 

Almost every day 
1994 

Once or twice a week 
1994 

Once or twice a month 
1994 

Never or hardly ever 
1994 


Percentage and Proficiency 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Concerning how many books were read by fourth-grade public school students in 
Washington, Table 8.2 reveals that: 

• Less than half of the Washington students in 1994 (39 percent) read five 
or more books on their own outside of school in the month preceding 
the assessment. This figure was somewhat smaller than that of students 
across the nation, where 42 percent of the students reported reading the 
same number of books. 

• In 1994 in Washington, average reading proficiency was lowest for 
students who read no books on their own outside of school during the 
month prior to the assessment. 
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TABLE 8.2 

Public School Students’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial State Assessment 


Washington 


West 


Nation 


During the past month , how 
many books have you read on 
your own outside of school? 

None 

1994 

One or two 

1994 

Three or four 

1994 

Five or more 
1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Finally, regarding the frequency with which students took books out of the school 
library or public library for their own enjoyment, from Table 8.3: 

• In Washington in 1994, 65 percent of the fourth-grade public school 
students took books out of the library for their own enjoyment at least 
once a week. This percentage did not differ significantly from that for 
the nation (63 percent). 

• In 1994, public school fourth graders in Washington who took books 
out of the library at least once a week had an average reading 
proficiency (216) that was higher than that of students who never or 
hardly ever took books out of the library for their own enjoyment (202). 




TABLE 8.3 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library 



1994 Trial State Assessment 



Washington 



West 



Nation 



How often do you take books 
out of the school library or 
public library for your own 
enjoyment? 

Almost every day 

1994 

Once or twice a week 

1994 

Once or twice a month 

1994 

Never or hardly ever 

1994 
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The NAEP reading scale ranges from 0 to 500. 
with about 95 percent confidence that, for each 
standard errors of the estimate for the sample, 
difference (see Appendix A for details). 



The standard errors of the statistics appear in parentheses. It can be said 
population of interest, the value for the entire population is within ± 2 
In comparing two estimates, one must use the standard error of the 
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Reading in the Home 

The presence of parents or siblings who model and share reading and the 
availability of reading materials in the home are critical factors in the development of 
students’ appreciation of reading and, ultimately, their comprehension and fluency. 55 
Students participating in the Trial State Assessment Program were asked about the 
availability of newspapers, magazines, books, and an encyclopedia at home. They were 
also asked about the frequency with which they discussed things they had read with 
friends and family. 

Average reading proficiency associated with having zero to two, three, or four of 
these types of materials in the home is shown in Table 8.4. The data for public school 
fourth-grade students in 1994 reveal that: 

• In Washington, 34 percent of the students reported having all four of 
these types of materials in the home. This figure was not significantly 
different from that for the nation (36 percent). 

• Students in Washington who had all four of these types of materials in 
the home showed an average reading proficiency (222) that was higher 
than that of students with zero to two types of materials (201). 
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TABLE 8.4 

Public School Students’ Reports on Types of Reading 
Materials in the Home 



1994 Trial State Assessment 


Washington 


West 


Nation 


Does your family have, or receive on a 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



55 L.C. Moll. “Literary Research in Community and Classrooms: A Sociocultural Approach,” in B.D. Ruddell and H. 
Singer, Eds.. Theoretical Models of Reading. (Newark, DE: • International Reading Association, 1994). pp. 179-207; 
B. Rogoff. Apprenticeship in Thinking. (New York, NY: Oxford University Press, 1990); D. Taylor. Family Literacy- 
Young Children Learning to Read and Write. (Exeter, NH: Heinemann Educational Books, 1983). 
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Regarding the frequency with which fourth-grade public school students discuss 
what they read with friends and family. Table 8.5 shows that: 

• In 1994 in Washington, 26 percent of the students discussed with friends 
or family what they read almost every day. This percentage did not 
differ significantly from that of students across the nation (28 percent). 

• In 1994, the proficiency of students in Washington who discussed what 
they read with friends or family almost every day (212) did not differ 
significantly from that of students that had discussions with friends or 
family less than weekly (207). 
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TABLE 8.5 

Public School Students y Reports on Talking With 
Friends and Family About Reading 



1994 Thai State Assessment 


Washington 


West 


Nation 


How often do you talk with 
your friends or family about 
something you have read? 

Almost every day 
1994 

Once or twice a week 
1994 

Less than weekly 
1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Hours of Television Watched Per Day 

Many avid student readers watch a lot of television, while other children neither 
watch much television nor read. 56 However, despite these findings, it is generally 
believed that television viewing has an effect on time given to reading — frequent 
television viewing limits the amount of time available for other activities such as 
reading. 57 Students participating in the Trial State Assessment Program were asked to 
report on the amount of television they watched each day. Table 8.6 shows that, in 
Washington public schools in 1994: 

• Relatively few of the fourth-grade students (13 percent) watched six 
hours or more of television each day. This was smaller than the figure 
for the nation, where 22 percent of the students watched this much 
television. 

• Average reading proficiency in Washington was lowest for students who 
spent six hours or more watching television each day. 
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TABLE 8.6 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessmenl 


Washington 


West 


Nation 


How much television do you 
usually watch each day? 

One hour or less 
1994 

Two hours 
1994 

Three hours 
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Four to five hours 
1994 

Six hours or more 
1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses, it can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



56 S. Neuman. “The Home Environment and Fifth-grade Students’ Leisure Reading,” in Elementary School Journal, 
83 . (1986). pp. 333-343. 



7 P. Heather. Young People’s Reading: A Study of the Leisure Reading of 13-15 Year Olds . (Sheffield, England: 
University of Sheffield, Center for Research on User Studies, 1981). 
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APPENDIX A 



Procedural Appendix 



1^ his appendix provides an overview of the technical details of the 1994 Trial 
State Assessment Program in reading. It includes a discussion of the history of NAEP, 
the assessment design, the reading framework and objectives upon which the assessment 
was based, and the procedures used to analyze the results. 

A Recent History of NAEP 

The National Assessment of Educational Progress (NAEP) is a congressionally 
mandated project of the National Center for Education Statistics (NCES) that has 
collected and reported information since 1969 on what American students know and 
what they can do. It is the nation’s only ongoing, comparable, and representative 
assessment of student achievement. Its assessments are given to representative samples 
of youths attending both public and non-public schools and enrolled in grades 4, 8, 
and 12. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and 
territories to participate voluntarily in a trial state assessment, using samples 
representative of their own students, to provide state-level data comparable to the nation 
and each of the other participating jurisdictions. Pursuant to that law, in 1990, the 
mathematics achievement of public school eighth graders was assessed in 40 
jurisdictions (states, territories, and the District of Columbia). The results were reported 
in The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and 
the Trial Assessment of the States (Washington, DC: National Center for Education 
Statistics, 1991). In 1992, the mathematics achievement of fourth- and eighth-grade 
public school students and the reading achievement of fourth-grade public school 
students were assessed in 44 jurisdictions. The results of these assessments were 
reported in NAEP 1992 Mathematics Report Card for the Nation and the States 
(Washington, DC: National Center for Education Statistics, 1993) and NAEP 1992 
Reading Report Card for the Nation and the States (Washington, DC: National Center 
for Education Statistics, 1993). 
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For the 1994 Trial State Assessment Program, the reading achievement of 
fourth-grade students was again assessed in 44 jurisdictions. Forty jurisdictions involved 
in the 1992 assessment were also involved in the 1994 assessment. The results for 
Washington are reported in this document. 

A difference between the 1994 Trial State Assessment and previous Trial State 
Assessments is the addition of samples of non-public school students, in addition to the 
public school student samples. The purpose of this addition is to provide overall 
state-level data for each jurisdiction that is more easily comparable to overall state-level 
data for the other participating jurisdictions. 

Over time there have been many changes in emphasis of NAEP assessment and 
reporting, both to take advantage of new technologies and to reflect changing trends in 
education. In 1984, a new technology called Item Response Theory (IRT) made it 
possible to create “scale scores” for NAEP similar to those the public was accustomed 
to seeing for the annual Scholastic Achievement Test (SAT). The 1992 reading reports 
marked NCES’s continued attempt to shift to standards-based reporting. The transition 
was made to report NAEP results by “achievement levels.” Achievement levels describe 
how students should perform relative to a body of content reflected in the NAEP 
frameworks (i.e., how much students should know). The impetus for this shift was 
grounded in the belief that NAEP data would take on more meaning for the public if they 
show what proportion of our youth are able to meet standards of performance necessary 
for a changing world. The 1994 report continues to use the achievement levels initially 
implemented in 1992. 

Assessment Content 

The objectives for the 1992 and 1994 assessments were developed through a 
consensus process managed by the Council of Chief State School Officers, and the items 
were developed through a similar process managed by Educational Testing Service. The 
development of the Trial State Assessment Program benefitted from the involvement of 
hundreds of representatives from State Education Agencies who attended numerous 
NETWORK meetings; served on committees; reviewed the framework, objectives, and 
questions; and, in general, provided important suggestions on all aspects of the program. 

The reading assessment framework was a four-by-three matrix specifying four 
reading stances — Initial Understanding, Developing an Interpretation, Personal 
Reflection and Response, and Demonstrating a Critical Stance — and three reading 
purposes — reading for literary experience, reading to be informed, and reading to 
perform a task. However, the reading to perform a task category was not evaluated or 
reported for grade 4. Figures A.l and A.2 describe the reading purposes and stances. 
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FIGURE A.1 

Description of Reading Purposes 



Reading involves an interaction between a specific type of text or written material and 
a reader who has a purpose for reading that is related to the type of text and the context 
of the reading situation. The 1992 and 1994 NAEP reading assessments presented three 
types of text to students representing each of three reading purposes: literary text for 
literary experience, informational text to gain information, and documents to perform a 
task. At grade 4, only the first two reading purposes were assessed. Each block in the 
assessment contains questions that assess only one reading purpose. 
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Reading for Literary Experience 



Reading for literary experience involves reading literary text to explore the human 
condition, to relate narrative events with personal experience, and to consider the 
interplay in the selection among emotions, events, and possibilities. Students in the 
NAEP reading assessment were provided with a wide variety of literary texts such as 
short stories, poems, fables, historical fiction, science fiction, and mysteries. 



Reading to Gain Information 



Reading to gain information involves reading informative passages in order to obtain 
some general or specific information. This often requires a more utilitarian approach 
to reading that requires the use of certain reading/thinking strategies different from 
those used for other purposes. In addition, reading to gain information often involves 
reading and interpreting adjunct aids such as charts, graphs, maps, and tables that 
provide supplemental or tangential data. Informational passages in the NAEP reading 
assessment included biographies, science articles, encyclopedia entries, primary and 
secondary historical accounts, and newspaper editorials. 



Reading to Perform ;a Task f 



Reading to perform a task involves reading various types of materials for the purpose 
of applying the information or directions in completing a specific task. The reader’s 
purpose for gaining meaning extends beyond understanding the text to include the 
accomplishment of a certain activity. Documents requiring students in the NAEP 
reading assessment to perform a task included directions for creating a time capsule, 
instructions on how to write a letter to your Senator, a bus schedule, and a tax form. 
In 1992 and 1994, reading to perform a task was assessed only at grades 8 and 12. 
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FIGURE A.2 

Description of Reading Stances 



Readers interact with text in various ways as they use background knowledge and 
understanding of text to construct, extend, and examine meaning. The NAEP reading 
assessment framework specified four reading stances to be assessed that represent 
various interactions between readers and texts. These stances are not meant to describe 
a hierarchy of skills or abilities. Rather, they are intended to describe behaviors that 
readers at all developmental levels should exhibit. 

Initial Understanding 



Initial understanding requires a broad, preliminary construction of an understanding 
of the text. Questions testing this aspect ask the reader to provide an initial 
impression or unreflected understanding of what was read. In the 1992 and 1994 
NAEP reading assessments, the first question following a passage was usually one 
testing initial understanding. 



Developing an Interpretation 



Developing an interpretation requires the reader to go beyond the initial impression 
to develop a more complete understanding of what was read. Questions testing this 
aspect require a more specific understanding of the text and involve linking 
information across parts of the text as well as focusing on specific information. 



Personal Reflection and: Response ! 



Personal response requires the reader to connect knowledge from the text more 
extensively with his or her own personal background knowledge and experience. The 
focus is on how the text relates to personal experience, and questions on this aspect 
ask the readers to reflect and respond from a personal perspective. For the 1992 and 
1994 NAEP reading assessments, personal response questions were typically 
formatted as constructed-response items to allow for individual possibilities and varied 
responses. 



Demonstrating tia Critical Stance 



Demonstrating a critical stance requires the reader to stand apart from the text, 
consider it, and judge it objectively. Questions on this aspect require the reader to 
perform a variety of tasks such as critical evaluation, comparing and contrasting, 
applications to practical tasks, and understanding the impact of such text features as 
irony, humor, and organization. These questions focus on the reader as critic and 
require reflection on and judgments about how the text is written. 
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Assessment Design 

The 1994 reading assessment was based on a focused balanced incomplete block 
(BIB) spiral matrix design — a design that enables broad coverage of reading content 
while minimizing the burden for any one student. The 1994 NAEP reading assessment 
for grades 4, 8, and 12 contained a total of 153 discrete constructed-response questions 

— 126 of which were short constructed-response (78 scored using a two-point scoring 
rubric and 48 using a three-point scoring rubric), and 27 of which were extended 
constructed-response questions (scored using a four-point scoring rubric). Some of the 
questions in the assessment were administered at more than one grade. Therefore, the 
sum of the number of questions administered at each grade does not equal the total 
number of questions in the assessment. 

At grade 4, 84 reading questions were developed for the national assessment, 
including 37 short constructed-response questions, eight extended constructed-response 
questions, and 39 multiple-choice questions. These same questions were administered 
to the Trial State Assessment samples of grade 4 students. A subset of the grade 4 
exercise pool consisted of questions that were previously administered in 1992. These 
“trend” questions made it possible to report the 1992 and 1994 results on a common 
scale. 

The first step in implementing the BIB design required selecting grade-appropriate 
passages and developing questions to assess the four reading stances specified in the 
framework. The questions were assembled into units called blocks , with each block 
designed to be completed in 25 or 50 minutes. At grade 4, eight blocks were designed; 
they required 25 minutes of student time for completion. The blocks were assembled 
into assessment booklets so that each booklet contained three background questionnaires 

— the first consisting of general background questions, the second comprising reading 
background questions, and the third containing questions about the students’ motivation 
to do well in the assessment — and two blocks of cognitive reading questions. The 
questions in the first section were read aloud to the students, usually taking about 10 
minutes to complete. Students were then given 50 minutes to complete two 25-minute 
blocks of reading questions, five minutes to complete the second background 
questionnaire, and three minutes to complete the third background questionnaire. Thus, 
the assessment required slightly over one hour of student time. 

In accordance with the BIB design, the blocks were assigned to the assessment 
booklets so that there were a total of 16 booklets at grade 4. Blocks of cognitive reading 
questions were paired with blocks assessing the same purpose for reading as well as 
blocks assessing other purposes. (Readers should refer to the 1994 NAEP State 
Technical Report for a more complete discussion of the BIB design.) The booklets were 
spiraled or interleaved in a systematic sequence so that each booklet appeared an 
appropriate number of times in the sample. The students within an assessment session 
were assigned booklets in the order in which the booklets were spiraled. Thus, students 
in any given session received a variety of different booklets and only a small number 
of students in the session received the same booklet. 
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Participation Guidelines 

Unless the overall participation rate is sufficiently high for a jurisdiction, there is 
a risk that the assessment results for that jurisdiction are subject to appreciable 
nonresponse bias. Moreover, even if the overall participation rate is high, there may 
be significant nonresponse bias if the nonparticipation that does occur is heavily 
concentrated among certain types of schools or students. The following guidelines 
concerning school and student participation rates in the Trial State Assessment Program 
were established to address four significant ways in which nonresponse bias could be 
introduced into the jurisdiction sample estimates. The conditions that will result in the 
publication of a jurisdiction’s results are presented below. Also presented below are the 
conditions that will result in a jurisdiction receiving a notation in the 1994 reports. Note 
that in order for a jurisdiction’s results to be published with no notations, that jurisdiction 
must satisfy all guidelines. 

Guidelines on the Publication of NAEP Results 



Guideline 1 — Publication of Public School Results 
A jurisdiction will have its public school results published in the 1994 
NAEP Reading Report Card if and only if its weighted participation rate 
for the initial sample of public schools is greater than or equal to 70 
percent. Similarly, a jurisdiction will receive a separate NAEP State 
Report if and only if its weighted participation rate for the initial sample 
of public schools is greater than or equal to 70 percent. 

Guideline 2 — Publication of Non-Public School Results 
A jurisdiction will have its non-public school results published in the 
1994 NAEP Reading Report Card if and only if its weighted 
participation rate for the initial sample of non-public schools is greater 
than or equal to 70 percent AND meets minimum sample size 
requirements. 1 A jurisdiction eligible to receive a separate NAEP State 
Report under guideline 1 will have its non-public school results included 
in that report if and only if that jurisdiction’s weighted participation rate 
for the initial sample of non-public schools is greater than or equal to 
70 percent AND meets minimum sample size requirements. If a 
jurisdiction meets guideline 2 but fails to meet guideline 1, a separate 
NAEP State Report will be produced containing only non-public school 
results. 

Guideline 3 — Publication of Combined Public and Non-Public 

School Results 

A jurisdiction will have its combined results published in the 1994 
NAEP Reading Report Card if and only if both guidelines 1 and 2 are 
satisfied. Similarly, a jurisdiction eligible to receive a separate NAEP 
State Report under guideline 1 will have its combined results included 
in that report if and only if guideline 2 is also met. 




Minimum sample size requirements for. reporting non-public school data consist of two components: (1) a school 
sample size of six or more participating schools and (2) an assessed student sample size of at least 62. 
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Discussion: If a jurisdiction’s public or non-public school participation rate for 
the initial sample of schools is below 70 percent there is a substantial possibility that 
bias will be introduced into the assessment results. This possibility remains even after 
making statistical adjustments to compensate for school nonparticipation. There remains 
the likelihood that, in aggregate, the substitute schools are sufficiently dissimilar from 
the originals that they are replacing and represent too great a proportion of the 
population to discount such a difference. Similarly, the assumptions underlying the use 
of statistical adjustments to compensate for nonparticipation are likely to be significantly 
violated if the initial response rate falls below the 70 percent level. Guidelines 1, 2, 
and 3 take this into consideration. These guidelines are congruent with current NAGB 
policy, which requires that data for jurisdictions that do not have a 70 percent 
before-substitution participation rate be reported “in a different format” and with the 
Education Information Advisory Committee (EIAC) resolution, which calls for data from 
such jurisdictions not to be published. 

Guidelines on Notations of NAEP Results 



Guideline 4 — Notation for Overall Public School Participation Rate 
A jurisdiction which meets guideline 1 will receive a notation if its 
weighted participation rate for the initial sample of public schools was 
below 85 percent AND the weighted public school participation rate 
after substitution was below 90 percent. 

Guideline 5 — Notation for Overall Non-Public School Participation 

Rate 

A jurisdiction which meets guideline 2 will receive a notation if its 
weighted participation rate for the initial sample of non-public schools 
was below 85 percent AND the weighted non-public school participation 
rate after substitution was below 90 percent. 

Discussion: For jurisdictions that did not use substitute schools, the participation 
rates are based on participating schools from the original sample. In these situations, 
the NCES standards specify weighted school participation rates of at least 85 percent to 
guard against potential bias due to school nonresponse. Thus, the first part of these 
guidelines, referring to the weighted school participation rate for the initial sample of 
schools, is in direct accordance with NCES standards. 
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To help ensure adequate sample representation for each jurisdiction participating 
in the 1994 Trial State Assessment Program, NAEP provided substitutes for 
nonparticipating public and non-public schools. When possible, a substitute school was 
provided for each initially selected school that declined participation before November 
15, 1993. For jurisdictions that used substitute schools, the assessment results will be 
based on the student data from all schools participating from both the original sample 
and the list of substitutes (unless both an initial school and its substitute eventually 
participated, in which case only the data from the initial school will be used). 

The NCES standards do not explicitly address the use of substitute schools to 
replace initially selected schools that decide not to participate in the assessment. 
However, considerable technical consideration was given to this issue. Even though the 
characteristics of the substitute schools were matched as closely as possible to the 
characteristics of the initially selected schools, substitution does not entirely eliminate 
bias due to the nonparticipation of initially selected schools. Thus, for the weighted 
school participation rates including substitute schools, the guidelines were set at 90 
percent. 

If a jurisdiction meets either standard (i.e., 85 percent or higher prior to 
substitution or 90 percent or higher after substitution) then there will be no notation for 
the relevant overall school participation rate. 

Guideline 6 — Notation for Strata-Specific Public School Participation 

Rate 

A jurisdiction which is not already receiving a notation under 

guideline 4 will receive a notation if the nonparticipating public schools 

included a class of schools with similar characteristics, which together 
accounted for more than five percent of the jurisdiction’s total 

fourth-grade weighted sample of public schools. The classes of schools 
from each of which a jurisdiction needed minimum school participation 
levels were determined by degree of urbanization, minority enrollment, 
and median household income of the area in which the school is located. 

Guideline 7 — Notation for Strata-Specific Non-Public School 
Participation Rate 

A jurisdiction which is not already receiving a notation under 

guideline 5 will receive a notation if the nonparticipating non-public 
schools included a class of schools with similar characteristics, which 
together accounted for more than five percent of the jurisdiction’s total 
fourth-grade weighted sample of non-public schools. The classes of 
schools from each of which a jurisdiction needed minimum school 
participation levels were determined by type of non-public school 
(Catholic versus non-Catholic) and location (metropolitan versus 
non-metropolitan). 
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Discussion: The NCES standards specify that attention should be given to the 
representativeness of the sample coverage. Thus, if some important segment of the 
jurisdiction’s population is not adequately represented, it is of concern, regardless of the 
overall participation rate. 

These guidelines address the fact that, if nonparticipating schools are concentrated 
within a particular class of schools, the potential for substantial bias remains, even if the 
overall level of school participation appears to be satisfactory. Nonresponse adjustment 
cells for public schools have been formed within each jurisdiction, and the schools 
within each cell are similar with respect to minority enrollment, degree of urbanization, 
and/or median household income, as appropriate for each jurisdiction. For non-public 
schools, nonresponse adjustment cells are determined by type and location of school. 

If more than five percent (weighted) of the sampled schools (after substitution) 
are nonparticipants from a single adjustment cell, then the potential for nonresponse bias 
is too great. These guidelines are based on the NCES standard for strata-specific school 
nonresponse rates. 

Guideline 8 — Notation for Overall Student Participation Rate in 

Public Schools 

A jurisdiction which meets guideline 1 will receive a notation if the 
weighted student response rate within participating public schools was 
below 85 percent. 

Guideline 9 — Notation for Overall Student Participation Rate in 
Non-Public Schools 

A jurisdiction which meets guideline 2 will receive a notation if the 
weighted student response rate within participating non-public schools 
was below 85 percent. 

Discussion: These guidelines follow the NCES standard of 85 percent for overall 
student participation rates. The weighted student participation rate is based on all 
eligible students from initially selected or substitute schools who participated in the 
assessment in either an initial session or a make-up session. If the rate falls below 
85 percent, then the potential for bias due to students’ nonresponse is too great. 

Guideline 10 — Notation for Strata-Specific Student Participation 
Rate in Public Schools 

A jurisdiction which is not already receiving a notation under 
guideline 8 will receive a notation if the nonresponding students within 
participating public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable public school student sample. Student 
groups from which a jurisdiction needed minimum levels of participation 
were determined by age of student and type of assessment session 
(unmonitored or monitored), as well as school level of urbanization, 
minority enrollment, and median household income of the area in which 
the school is located. 
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Guideline 11 — Notation for Strata-Specific Student Participation 
Rate in Non-Public Schools 



A jurisdiction which is not already receiving a notation under 
guideline 9 will receive a notation if the nonresponding students within 
participating non-public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable non-public school student sample. 

Student groups from which a jurisdiction needed minimum levels of 
participation were determined by age of student and type of assessment 
session (unmonitored or monitored), as well as type and location of 
school. 

Discussion: These guidelines address the fact that if nonparticipating students are 
concentrated within a particular class of students, the potential for substantial bias 
remains, even if the overall student participation level appears to be satisfactory. Student 
nonresponse adjustment cells have been formed using the school-level nonresponse 
adjustment cells, together with the student’s age and the nature of the assessment session 
(unmonitored or monitored). If more than five percent (weighted) of the invited students 
who do not participate in the assessment are from a single adjustment cell, then the 
potential for nonresponse bias is too great. These guidelines are based on the NCES 
standard for strata-specific student nonresponse rates. 

Data Analysis and Scales 

Once the assessments were conducted and information from the assessment 
booklets had been compiled in a database, the assessment data were weighted to match 
known population proportions and adjusted for nonresponse. Analyses were then 
conducted to determine the percentages of students who gave various responses to each 
cognitive and background question. 

For both the 1992 and 1994 assessments, item response theory (IRT) was used to 
estimate average reading proficiency for each jurisdiction and for various 
subpopulations, based on students’ performance on the set of reading questions they 
received. IRT provides a common scale on which performance can be reported for the 
nation, each jurisdiction, and subpopulations, even when all students do not answer the 
same set of questions. Furthermore, these IRT scales provide a mechanism for 
comparing the reading results obtained in 1994 with those from 1992 even though there 
were some differences between the sets of questions that were administered in the two 
assessment years. This common scale makes it possible to report on relationships 
between students’ characteristics (based on their responses to the background questions) 
and their overall performance on the assessment. 
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The results from the 1994 assessment are reported on scales ranging from 0 to 500 
that were created to summarize performance for each of the two reading purposes at 
grade 4 (reading for literary experience and reading to gain information). The scales 
summarize examinee performance across all four question types used in the assessment 
(multiple-choice, dichotomous ly-scored constructed-response, regular 
constructed-response, and extended constructed-response). In producing the scales, three 
distinct IRT models were used. Multiple-choice questions were scaled using the 
three-parameter logistic model; dichotomously-scored constructed-response questions 
were scaled using the two-parameter logistic model; the regular and extended 
constructed-response questions were scaled using a generalized partial-credit model. 
Each reading purpose scale was based on the distribution of student performance across 
the grades assessed in the 1992 national assessment (grades 4, 8, and 12) and had a mean 
of 250 and a standard deviation of 50 for that reference population. A composite scale 
was created as an overall measure of students’ reading proficiency. At grade 4, the 
composite scale was a weighted average of the two reading purpose scales, where the 
weight for each reading purpose was proportional to the relative importance assigned to 
that purpose in the specifications developed by the Reading Objectives Panel (55 percent 
for the literary experience scale and 45 percent for the gaining information scale). 

Questionnaires for Teachers and Schools 

As part of the Trial State Assessment Program, questionnaires were given to the 
reading teachers of assessed students and to the principal or other administrator in each 
participating school. A Background Panel drafted a set of issues and guidelines and 
made recommendations concerning the design of these questionnaires. For the 1992 and 
1994 assessments, the teacher and school questionnaires focused on five educational 
areas: instructional content, instructional practices and experiences, teacher 
characteristics, school conditions and context, and conditions beyond school (i.e., home 
support, out-of-school activities, and attitudes). Similar to the development of the 
materials given to students, the guidelines and the teacher and school questionnaires 
were prepared through an iterative process that involved extensive development, field 
testing, and review by external advisory groups. 

It is important to note that in this report, as in all NAEP reports, the student is 
always the unit of analysis, even when information from the teacher or school 
questionnaire is being reported. Having the student as the unit of analysis makes it 
possible to describe the instruction received by representative samples of fourth-grade 
students. Although this approach may provide a different perspective from that which 
would be obtained by simply collecting information from a sample of fourth-grade 
reading teachers or from a sample of schools, it is consistent with NAEP’s goal of 
providing information about the educational context and performance of students. 
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The questionnaires for fourth-grade teachers consisted of two parts. The first 
requested information about the teacher, such as race/ethnicity and gender, as well as 
academic degrees held, teaching certification, training in reading, and the availability 
of instructional resources. In the second part, teachers were asked to provide 
information on each class they taught that included one or more students who 
participated in the Trial State Assessment Program. The information included, among 
other things, the extent to which worksheets or workbooks were used and the frequency 
with which various instructional approaches were employed. Because of the nature of 
the sampling for the Trial State Assessment Program, the responses to the reading 
teacher questionnaire do not necessarily represent all fourth-grade reading teachers in a 
jurisdiction. Rather, they represent the teachers of the particular students being assessed. 

An extensive school questionnaire was completed by principals or other 
administrators in the schools participating in the Trial State Assessment Program. The 
school questionnaire contained questions about school policies, course offerings, and 
special priority areas, among other topics. 

Estimating Variability 

The statistics reported by NAEP (average proficiencies, percentages of students 
at or above particular achievement levels, and percentages of students responding in 
certain ways to background questions) are estimates of the corresponding information 
for the population of fourth-grade students in public or non-public schools in a 
jurisdiction. These estimates are based on the performance of carefully selected, 
representative samples of fourth-grade students from the jurisdiction. 

If a different representative sample of students were selected and the assessment 
repeated, it is likely that the estimates might vary somewhat, and both of these sample 
estimates might differ somewhat from the value of the mean or percentage that would 
be obtained if every fourth-grade public or non-public school student in the jurisdiction 
were assessed. Virtually all statistics that are based on samples (including those in 
NAEP) are subject to a certain degree of uncertainty. The uncertainty attributable to 
using samples of students is referred to as sampling error . 

Like almost all estimates based on assessment measures, NAEP’s total group and 
subgroup performance estimates are subject to a second source of uncertainty, in addition 
to sampling error. As previously noted, each student who participated in the Trial State 
Assessment Program was administered a subset of questions from the total set of 
questions. If each student had been administered a different, but equally appropriate, 
set of the assessment questions — or the entire set of questions — somewhat different 
estimates of total group and subgroup performance might have been obtained. Thus, a 
second source of uncertainty arises because each student was administered a subset of 
the total pool of questions. 
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The measures of uncertainty of the estimates of reading performance statistics 
reflect both sources of uncertainty discussed above. These measures of the uncertainty 
are called standard errors and are given in parentheses in each of the tables in the report. 
Standard errors reflecting both sampling and measurement error are reported for 
estimates of average proficiency and percentage of students at or above particular 
achievement levels. The standard errors of the other statistics (such as the percentage 
of students answering a background question in a certain way or the percentage of 
students in certain racial/ethnic groups) reflect only sampling error. NAEP uses a 
methodology called the jackknife procedure to estimate all of these standard errors. 

The reader is reminded that, as in all surveys, NAEP results are also subject to 
other kinds of errors including the effects of necessarily imperfect adjustment for student 
and school nonresponse and other largely unknowable effects associated with the 
particular instrumentation and data collection methods used. Nonsampling errors can 
be attributed to a number of sources: inability to obtain complete information about all 
selected students in all selected schools in the sample (some students or schools refused 
to participate, or students participated but answered only certain questions); ambiguous 
definitions; differences in interpreting questions; inability or unwillingness to give 
correct information; mistakes in recording, coding, or scoring data; and other errors of 
collecting, processing, sampling, and estimating missing data. The extent of 
nonsampling errors is difficult to estimate. By their nature, the impact of such errors 
cannot be reflected in the data-based estimates of uncertainty provided in NAEP reports. 

Prawin2 Inferences from the Results 

One of the goals of the Trial State Assessment Program is to make inferences 
about the overall population of fourth-grade students in each participating jurisdiction 
based on the particular sample of students assessed. The results from the sample — 
taking into account the uncertainty associated with all samples — are used to make 
inferences about the population. The use of confidence intervals , based on the standard 
errors, provides a way to make inferences about the population means and percentages 
in a manner that reflects the uncertainty associated with the sample estimates. An 
estimated sample mean proficiency ± 2 standard errors approximates a 95 percent 
confidence interval for the corresponding population quantity. This means that with 
approximately 95 percent confidence, the average performance of the entire population 
of interest (e.g., all fourth-grade students in public schools in a jurisdiction) is within ± 
2 standard errors of the sample mean. 
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As an example, suppose that the average reading proficiency of the students in a 
particular jurisdiction’s fourth-grade sample were 256 with a standard error of 1.2. A 
95 percent confidence interval for the population quantity would be as follows: 

Mean ± 2 standard errors = 256 ± 2 x (1 .2) = 256 ± 2.4 = 

256 - 2.4 and 256 + 2.4 = (253.6, 258.4) 

Thus, one can conclude with 95 percent confidence that the average proficiency 
for the entire population of fourth-grade students in public schools in that jurisdiction 
is between 253.6 and 258.4. 

Similar confidence intervals can be constructed for percentages, provided that the 
percentages are not extremely large (greater than 90 percent ) or extremely small (less 
than 10 percent). For extreme percentages, confidence intervals constructed in the above 
manner may not be appropriate and procedures for obtaining accurate confidence 
intervals are quite complicated. 

Analyzing Subgroup Differences in Proficiencies and Percentages 

In addition to the overall results, this report presents outcomes separately for a 
variety of important subgroups. Many of these subgroups are defined by shared 
characteristics of students, such as their gender or race/ethnicity, and the type of location 
in which their school is situated. Other subgroups are defined by students’ responses 
to background questions. Still other subgroups are defined by the responses of the 
assessed students’ reading teachers to questions in the reading teacher questionnaire. 

In Chapter 1 of this report, differences between the jurisdiction and nation were 
tested for overall reading proficiency and for each of the purposes for reading. In 
Chapter 2, significance tests were conducted for the overall proficiency for each of the 
subpopulations. Chapter 3 reports differences between the jurisdiction and nation for 
the percentage of students at or above the Proficient level, and Chapter 4 contains 
significance tests for the percentage of students at or above the Proficient level for each 
of the subpopulations. In Chapters 5-8, comparisons were made across subgroups for 
responses made to various background questions. 
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As an example, consider the question: Do students who reported reading three 
or four books outside of school each month exhibit higher average reading proficiency 
than students who reported reading no books outside of school? 

To answer the question posed above, begin by comparing the average reading 
proficiency for the two groups being analyzed. If the mean for the group that reported 
reading three or four books outside of school is higher, it may be tempting to conclude 
that that group does have higher reading proficiency than the group that reported reading 
no books outside of school. However, even though the means differ, there may be no 
real difference in performance between the two groups in the population because of the 
uncertainty associated with the estimated average proficiency of the groups in the 
sample. Remember that the intent is to make a statement about the entire population, 
not about the particular sample that was assessed. The data from the sample are used 
to make inferences about the population as a whole. 

As discussed in the previous section, each estimated sample mean proficiency (or 
percentage) has a degree of uncertainty associated with it. It is therefore possible that 
if all students in the population had been assessed, rather than a sample of students, or 
if the assessment had been repeated with a different sample of students or a different, 
but equivalent, set of questions, the performances of various groups would have been 
different. Thus, to determine whether there is a real difference between the mean 
proficiency (or percentage of a certain attribute) for two groups in the population, an 
estimate of the degree of uncertainty associated with the difference between the 
proficiency means or percentages of those groups must be obtained for the sample. This 
estimate of the degree of uncertainty — called the standard error of the difference 
between the groups — is obtained by taking the square of each group’s standard error, 
summing these squared standard errors, and then taking the square root of this sum. 

Similar to the manner in which the standard error for an individual group mean 
or percentage is used, the standard error of the difference can be used to help determine 
whether differences between groups in the population are real. The difference between 
the mean proficiency or percentage of the two groups ± 2 standard errors of the 
difference represents an approximate 95 percent confidence interval. If the resulting 
interval includes zero, there is insufficient evidence to claim a real difference between 
groups in the population. If the interval does not contain zero, the difference between 
groups is statistically significant (different) at the .05 level. 
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As another example, to determine whether the average reading proficiency of 
fourth-grade females is higher than that of fourth-grade males in a particular 
jurisdiction’s public schools, suppose that the sample estimates of the mean proficiencies 
and standard errors for females and males were as follows: 



Group 


Average Proficiency 


Standard Error 


Female 


259 


2.0 


Male 


255 


2.1 



The difference between the estimates of the mean proficiencies of females and 
males is four points (259 - 255). The standard error of this difference is 



V 2.0 2 + 2.1 2 = 2.9 

Thus, an approximate 95 percent confidence interval for this difference is 
Mean difference ± 2 standard errors of the difference = 

4 ± 2 x (2.9) = 4 ± 5.8 = 4 - 5.8 and 4 + 5.8 = (-1.8, 9.8) 

The value zero is within this confidence interval, which extends from -1.8 to 9.8 
(i.e., zero is between -1.8 and 9.8). Thus, there is insufficient evidence to claim a 
difference in average reading proficiency between the populations of fourth-grade 
females and males in public schools in the jurisdiction. 2 

Throughout this report, when the mean proficiencies or percentages for two groups 
were compared, procedures like the one described above were used to draw the 
conclusions that are presented. If a statement appears in the report indicating that a 
particular group had higher (or lower) average proficiency than a second group, the 95 
percent confidence interval for the difference between groups did not contain zero. 
When a statement indicates that the average proficiency or percentage of some attribute 
was not significantly different for two groups, the confidence interval included zero, and 
thus no difference could be assumed between the groups. The information described in 
this section also pertains to comparisons between 1992 and 1994. The reader is 
cautioned to avoid drawing conclusions solely on the basis of the magnitude of the 
differences. A difference between two groups in the sample that appears to be slight 
may represent a statistically significant difference in the population because of the 
magnitude of the standard errors. Conversely, a difference that appears to be large may 
not be statistically significant. 



~ The procedure described above (especially the estimation of the standard error of the difference) is, in a strict sense, 
only appropriate when the statistics being compared come from independent samples. For certain comparisons in the 
report, the groups were not independent. In those cases, a different (and more appropriate) estimate of the standard 
error of the difference was used. 
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The procedures described in this section, and the certainty ascribed to intervals 
(e.g., a 95 percent confidence interval), are based on statistical theory that assumes that 
only one confidence interval or test of statistical significance is being performed. 
However, in each chapter of this report, many different groups are being compared (i.e., 
multiple sets of confidence intervals are being analyzed). In sets of confidence intervals, 
statistical theory indicates that the certainty associated with the entire set of intervals is 
less than that attributable to each individual comparison from the set. To hold the 
certainty level for the set of comparisons at a particular level (e.g., .95), adjustments 
(called multiple comparison procedures) must be made to the methods described in the 
previous section. One such procedure — the Bonferroni method — was used in the 
analyses described in this report to form confidence intervals for the differences between 
groups whenever sets of comparisons were considered. Thus, the confidence intervals 
in the text that are based on sets of comparisons are more conservative than those 
described on the previous pages. A more detailed description of the use of the 
Bonferroni procedure appears in the 1994 NAEP State Technical Report. 

Statistics with Poorly Estimated Standard Errors 

The standard errors for means and proportions reported by NAEP are statistics and 
therefore are subject to a certain degree of uncertainty. In certain cases, typically when 
the standard error is based on a small number of students, or when the group of students 
is enrolled in a small number of schools, the amount of uncertainty associated with the 
standard errors may be quite large. Throughout this report, estimates of standard errors 
subject to a large degree of uncertainty are followed by the symbol In such cases, 
the standard errors — and any confidence intervals or significance tests involving these 
standard errors — should be interpreted cautiously. Further details concerning procedures 
for identifying such standard errors are discussed in the 1994 NAEP State Technical 
Report. 

Minimum Sub2roup Sample Sizes 

Results for reading performance and background variables were tabulated and 
reported for groups defined by race/ethnicity, type of location, parents’ education level, 
and gender. NAEP collects data for six racial/ethnic subgroups (White, Black, Hispanic, 
Asian, Pacific Islander, and American Indian/Alaskan Native), three types of locations 
(Central City, Urban Fringe/Large Town, and Rural/Small Town), and five levels of 
parents’ education (Graduated College, Some Education After High School, Graduated 
High School, Did Not Finish High School, and I Don’t Know). In the past, NAEP 
collected information for only five racial/ethnic subgroups, with Asian and Pacific 
Islander students combined into one subgroup. In addition, previous NAEP reports 
reported data for four types of communities, rather than for the three types of location. 
These types of communities were Advantaged Urban, Disadvantaged Urban, Extreme 
Rural, and Other types of communities. 
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In many jurisdictions, and for some regions of the country, the number of students 
in some of these groups was not sufficiently high to permit accurate estimation of 
performance and/or background variable results. As a result, data are not provided for 
the subgroups with very small sample sizes or for the subgroups with students from very 
few schools. For results to be reported for any Trial State Assessment Program 
subgroup, at least ten public schools or six non-public schools must be represented in 
the subgroup. For results to be reported for any National Assessment subgroup, at least 
five primary sampling units (PSU’s) must be represented in the subgroup. In addition, 
a minimum sample of 62 students per subgroup was required. For statistical tests 
pertaining to subgroups, the sample size for both groups had to meet the minimum 
sample size requirements. 

The minimum sample size of 62 was determined by computing the sample size 
required to detect an effect size of .5 total-group standard deviation units with a 
probability of .8 or greater. The effect size of .5 pertains to the true difference between 
the average proficiency of the subgroup in question and the average proficiency for the 
total fourth-grade public school population in the jurisdiction, divided by the standard 
deviation of the proficiency in the total population. If the true difference between 
subgroup and total group mean is .5 total-group standard deviation units, then a sample 
size of at least 62 is required to detect such a difference with a probability of .8. Further 
details about the procedure for determining minimum sample size appear in the 1994 
NAEP State Technical Report. 

Describing the Size of Percentages 

Some of the percentages reported in the text of the report are given qualitative 
descriptions. For example, the number of students being taught by teachers with 
master’s degrees in education might be described as “relatively few” or “almost all,” 
depending on the size of the percentage in question. Any convention for choosing 
descriptive terms for the magnitude of percentages is to some degree arbitrary. The 
descriptive phrases used in the report and the rules used to select them are shown on the 
following page. 
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Percentage 


Description of Text in Report 


p = 0 


None 


0 < p < 8 


A small percentage 


8 < p < 13 


Relatively few 


13 < p < 18 


Less than one fifth 


18 < p < 22 


About one fifth 


22 < p < 27 


About one quarter 


27 < p < 30 


Less than one third 


30 < p < 36 


About one third 


36 < p < 47 


Less than half 


47 < p < 53 


About half 


53 < p < 64 


More than half 


64 < p < 71 


About two thirds 


71 < p < 79 


About three quarters 


79 < p < 89 


A large majority 


89 < p < 1 00 


Almost all 


p = 100 


All 



Revisions to the 1992 and 1994 Findings 

In April 1995, results from the 1994 National and Trial State Assessment of 
reading were released as part of the report NAEP 1994 Reading: A First Look. 
Subsequently, ETS/NAEP discovered an error in the documentation for the ETS program 
used to compute NAEP scale score results. The error affected how omitted responses 
were treated in the IRT scaling of the extended constructed-response questions that 
received partial-credit scoring. The error affected only those questions; omitted 
multiple-choice and omitted short constructed responses were treated appropriately. 

The conventional treatment in NAEP subjects has been to treat omitted responses 
(blank responses to a question that are followed by valid responses to questions that 
appear later in the block) as the lowest possible score category in the production of 
NAEP scale scores. In contrast, not-reached responses (blank responses that are not 
followed by any further student responses) are treated as missing data. As a result of 
the documentation error, for a number of the polytomous constructed-response questions 
and across several subject areas, all blank responses (both omitted and not-reached 
responses) to affected questions were treated as missing — an acceptable treatment but 
not the conventional option of choice for NAEP. 
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The error affected a number of the NAEP scales constructed since 1992. 
Specifically, the 1992 and 1994 national and state reading results were affected by the 
error. Results from these two assessments have been released to the public in a number 
of NAEP publications. The 1992 data are also available to the public through NCES's 
secondary-use data files. 

It should be noted that this processing error also impacted the location of the 
National Assessment Governing Board (NAGB) achievement levels in reading, which 
were set on the 1992 scales. 

NCES and ETS felt that the most technically correct plan of action would be to 
recalculate all affected NAEP scales, no matter how slight the change, and to issue 
revised results. ETS was therefore instructed by NCES to recalculate all affected scales 
and to work with American College Testing (ACT) in the recomputation of the 
achievement level cutpoints. 

In recomputing the cutpoints, an additional error was discovered in the procedures 
used by ACT in 1992 to “map” the achievement level cutpoints onto the NAEP scale. 
The procedures contained an incorrectly derived formula. ACT used revised procedures 
with the correct formula to map the achievement level cutpoints for the 1994 history and 
geography scales. However, the error in the earlier procedures did affect achievement 
level cutpoints for reading, which were established during the 1992 assessment. The 
1992 national and state reading achievement level results were further impacted by this 
additional error. 

A new version of the NAEP 1994 Reading: A First Look report, containing the 
revised reading results, was issued by NCES in the fall of 1995. The main release of 
NAEP reading results, including the Reading Report Card, Cross-state Data 
Compendium , individual state reports, almanacs, technical report, and data files, 
originally scheduled for the end of September, took place instead in late fall. 

While some small changes in scale score results were found, the revised numbers 
for reading are quite similar to the results released in 1992 and to those published in the 
NCES April release of the reading First Look report. More specifically, the revised 
reading results are substantively equivalent to the originally published 1992 results and 
to the results released in the First Look. Regarding the 1992 and 1994 national 
assessment data, fourth-grade results are about 1 point lower than originally reported, 
while twelfth-grade results are about 1 point higher. These changes are small and not 
substantively meaningful. The eighth-grade numbers are essentially unchanged. The 
revised numbers indicate the same relative distances between reporting subgroups ( i.e ., 
race/ethnicity subgroups, male, female, etc.). The significant national score decline at 
grade 12 is totally unaffected by the revision, as is the absence of significant changes 
at grades 4 and 8. 
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With regard to the state assessment data, all jurisdictions were affected to roughly 
the same degree. Thus, the revised rank ordering of state performance in both 1 992 and 
1994 is essentially identical to that originally published. Original and revised trend 
results (i.e., the change in scores between 1992 and 1994) are extremely close for all the 
jurisdictions. However, in four instances (for Massachusetts, New Jersey, Utah, and 
California), the small changes engendered by the revision are sufficient to affect the 
statistical significance of the change. For Massachusetts, New Jersey, and Utah, the 
revised decline in scores is between 0.3 and 0.5 points smaller than the originally 
released results — a magnitude of change that was typical across all participants. When 
rounded to an integer, the original and revised declines for Massachusetts and New 
Jersey are of identical size and the decline for Utah went from 4 points to 3 points. 
Despite this similarity, the revised results for these states are no longer statistically 
significant since the original results were right on the margin of statistical significance. 
In California, the revised decline in scores is 0.4 points larger than the originally released 
results and is now statistically significant. 

In the results for state assessment achievement levels, there is little difference in 
the revised and original numbers from an interpretive standpoint. As expected, 
correction of the ACT error generally results in lower achievement level cutpoints and, 
hence, slightly higher percentages above the various cutpoints. The revised achievement 
level results in this technical report and in the reading reports reflect the change in the 
formula used in setting the achievement levels. 

There is one notable aspect of the revised state assessment achievement level 
results. Prior to the revision, only one state, Arizona, had shown a statistically 
significant increase from 1992 to 1994 in the percentage of students at the Advanced 
level. Based on the revised results, six more states — Connecticut, Florida, Kentucky, 
Maine, Mississippi, and Maryland — also showed a statistically significant increase at 
that level. 
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APPENDIX B 



Reading Stimuli 

This appendix contains replications of two of the eight reading passages used as the 
stimuli at grade 4. 
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SYBIL SOUNDS 
THE ALARM 

by Drollene P. Brown 



A red sky at night does not usually 
cause wonder. But on the evening of 
April 26, 1777, the residents of 

Ludingtons’ Mills were concerned. The 
crimson glow was in the east, not from 
the west where the sun was setting. 

The Ludington family sat at supper, 
each one glancing now and again toward 
the eastern window. Sybil, at sixteen the 
oldest of eight children, could read the 
question in her mother’s worried eyes. 
Would Henry Ludington have to go 
away again? As commander of the only 
colonial army regiment between 
Danbury, Connecticut, and Peekskill, 
New York, Sybil’s father did not have 
much time to be with his family. 

Thudding hooves in the yard abruptly 
ended their meal. The colonel pushed 
back his chair and strode to the door. 
Although Sybil followed him with her 



eyes, she dutifully began to help her 
sister Rebecca clear the table. 

The girls were washing dishes when 
their father burst back into the room with 
a courier at his side. 

“Here, Seth,” said the colonel, “sit 
you down and have some supper. 
Rebecca, see to our weary friend.” 

Sybil, glancing over her shoulder, saw 
that the stranger was no older than she. 
A familiar flame of indignation burned 
her cheeks. Being a girl kept her from 
being a soldier! 

Across the room, her parents were 
talking together in low tones. Her 
father’s voice rose. 

“Sybil, leave the dishes and come 
here,” he said. 

Obeying quickly, she overheard her 
father as he again spoke to her mother. 
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“Abigail, she is a skilled rider. It is 
Sybil who has trained Star, and the horse 
will obey her like no other.” 

‘That red glow in the sky,” Colonel 
Ludington said, turning now to his 
daughter, “is from Danbury. It’s been 
burned by British raiders. There are 
about two thousand Redcoats, and 
they’re heading for Ridgefield. 
Someone must tell our men that the lull 
in the fighting is over; they will have to 
leave their families and crops again.” 
TT1 go! Star and I can do it!” Sybil 
exclaimed. She faced her mother. “Star 
is sure of foot, and will carry me safely.” 
“There are dangers other than slip- 



pery paths,” her mother said, softly. 
“Outlaws or deserters or Tories or even 
British soldiers may be met. You must 
be wary in a way that Star cannot.” 

A lump rose in Sybil’s throat. “I can 
do it,” she declared. 

Without another word, Abigail 
Ludington turned to fetch a woolen cape 
to protect her daughter from the wind 
and rain. One of the boys was sent to 
saddle Star, and Sybil was soon ready. 
When she had swung up on her sturdy 
horse, the colonel placed a stick in her 
hand. 

As though reciting an oath, she 
repeated her father’s directions: “Go 

south by the river, then along Horse 
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Pond Road to Mohopac Pond. From 
there, turn right to Red Mills, then go 
north to Stormville.” The colonel stood 
back and saluted. She was off! 

At the first few isolated houses, 
windows or doors flew open as she 
approached. She shouted her message 
and rode on. By the time she reached 
the first hamlet, all was dark. There 
were many small houses there at the 
edge of Shaw’s Road, but everyone was 
in bed. Lights had not flared up at the 
sound of Star’s hoofbeats. Sybil had not 
anticipated this. Biting her lower lip, 
she pulled Star to a halt. After 
considering for a moment, she nudged 
the horse forward, and riding up to one 
cottage after another, beat on each door 
with her stick. 

“Look at the sky!” she shouted. 
“Danbury’s burning! All men muster at 
Ludingtons’!” 

At each village or cluster of houses, 
she repeated the cry. When lights began 
to shine and people were yelling and 
moving about, she would spur her horse 
onward. Before she and Star melted into 
the night, the village bells would be 
pealing out the alarm. 

Paths were slippery with mud and wet 
stones, and the terrain was often hilly 
and wooded. Sybil’s ears strained for 
sounds of other riders who might try to 
steal her horse or stop her mission. 
Twice she pulled Star off the path 
while unknown 



riders passed within a few feet. Both 
times, her fright dried her mouth and 
made her hands tremble. 

By the time they reached Stormville, 
Star had stumbled several times, and 
Sybil’s voice was almost gone. The 
town’s call to arms was sounding as they 
turned homeward. Covered with mud, 
tired beyond belief, Sybil could barely 
stay on Star’s back when they rode into 
their yard. She had ridden more than 
thirty miles that night. 

In a daze, she saw the red sky in the 
east. It was the dawn. Several hundred 
men were milling about. She had roused 
them in time, and Ludington’s regiment 
marched out to join the Connecticut 
militia in routing the British at 
Ridgefield, driving them back to their 
ships on Long Island Sound. 

Afterward, General George 
Washington made a personal visit to 
Ludingtons’ Mills to thank Sybil for her 
courageous deed. Statesman Alexander 
Hamilton wrote her a letter of praise. 

Two centuries later visitors to the area 
of Patterson, New York, can still follow 
Sybil’s route. A statue of Sybil on 
horseback stands at Lake Gleneida in 
Carmel, New York, and people in that 
area know well the heroism of Sybil 
Ludington. In 1978, a commemorative 
postage stamp was issued in her honor, 
bringing national attention to the heroic 
young girl who rode for independence. 



From Cobblestone's September, 1983, issue: 
“Patriotic Tales of the American Revolution.” 
Copyright 1983, Cobblestone Publishing Inc.. 
Peterborough, NH 03548. Reprinted by 
permission of the publisher. 
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HUNGRY SPIDER AND THE TURTLE 

by Harold Courlander and George Herzog 



Spider was a hungry one, he always wanted to eat. Everybody in Ashanti knew 
about his appetite. He was greedy, too, and always wanted more than his share of things. 
So people steered clear of Spider. 

But one day, a stranger came to Spider’s habitation out in the back country. His 
name was Turtle. Turtle was a long way from his home. He had been walking all day 
in the hot sun, and he was tired and hungry. So Spider had to invite Turtle into his house 
and offer him something to eat. He hated to do it, but if he didn’t extend hospitality to 
a tired traveler it would get back around the countryside and people would soon be 
talking about Spider behind his back. 

So he said to Turtle: 

“There is water at the spring for you to wash your feet in. Follow the trail and 
you'll get there. I'll get the dinner ready.” 

Turtle turned and waddled down to the spring with a gourd bowl as fast as he 
could. He dipped some water from the spring and carefully washed his feet in it. Then 
he waddled back up the trail to the house. But the trail was dusty. By the time Turtle 
got back to the house his feet were covered with dirt again. 

Spider had the food all set out. It was steaming, and the smell of it made Turtle’s 
mouth water. He hadn’t eaten since sunrise. Spider looked disapprovingly at Turtle’s 
feet. • 

“Your feet are awfully dirty,” he said. “Don’t you think you ought to wash them 
before you start to eat?” 

Turtle looked at his feet. He was ashamed, they were so dirty. So he turned 
around and waddled as fast as he could down to the spring again. He dipped some water 
out of the spring with the gourd bowl and carefully washed himself. Then he scurried 
as fast as he could back to the house. But it takes a turtle a while to get anywhere. 
When he came into the house Spider was already eating. 

“Excellent meal, isn’t it?” Spider said. He looked at Turtle’s feet with disapproval. 
“Hm, aren’t you going to wash yourself?” 

Turtle looked down at his feet. In his hurry to get back he had stirred up a lot 
of dust, and his feet were covered with it again. 

“I washed them,” he said. “I washed them twice. It’s your dusty trail that does 
it.” 

“Oh,” Spider said, “so you are abusing my house now!” He took a big mouthful 
of food and chewed it up, looking very hurt. 

“No,” Turtle said, sniffing the food. “I was just explaining.” 

“Well, run along and wash up so we can get on with the eating,” Spider said. 

Turtle looked. The food was already half gone and Spider was eating as fast as 
he could. 
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Turtle spun around and hurried down to the spring. He dipped up some water in the 
gourd bowl and splashed it over his feet. Then he scrambled back to the house. This 
time he didn’t go on the trail, though, but on the grass and through the bushes. It took 
him a little longer, but he didn’t get dust all over his feet. When he got to the house 
he found Spider licking his lips. 

“Ah, what a fine meal we had!” Spider said. 

Turtle looked in the dish. Everything was gone. Even the smell was gone. Turtle 
was very hungry. But he said nothing. He smiled. 

“Yes, it was very good,” he said. “You are certainly good to travelers in your 
village. If you are ever in my country you may be assured of a welcome.” 

“It’s nothing,” Spider said. “Nothing at all.” 

Turtle went away. He didn't tell other people about the affair at Spider’s house. 
He was quiet about his experience there. 

But one day many months later Spider was a long distance from home and he 
found himself in Turtle’s country. He found Turtle at the shore of the lake getting a 
sunbath. 

“Ah, friend Spider, you are far from your village,” Turtle said. “Will you have 
something to eat with me?” 

“Yes, that is the way it is when a person is far from home — generosity merits 
generosity,” Spider said hungrily. 

“Wait here on the shore and I’ll go below and prepare the food,” Turtle said. He 
slipped into the water and went down to the bottom of the lake. When he got there he 
set out the food to eat. Then he came to the top of the water and said to Spider, who 
was sitting impatiently on the shore, “All right, everything is ready. Let’s go down and 
eat.” He put his head under water and swam down. 

Spider was famished. He jumped into the water to follow Turtle. But Spider was 
very light. He floated. He splashed and splashed, kicked and kicked, but he stayed right 
there on top of the water. For a long time he tried to get down where Turtle was eating, 
but nothing happened. 

After a while Turtle came up, licking his lips. 

What’s the matter, aren’t you hungry?” he said. “The food is very good. Better 
hurry.” And he went down again. 

Spider made one more desperate try, but he just floated. Then he had an idea. 

He went back to the shore, picked up pebbles and put them in his pockets of his jacket. 
He put so many pebbles in his pockets that he became very heavy. He was so heavy 
he could hardly walk. Then he jumped into the water again, and this time he sank to 
the bottom, where Turtle was eating. The food was half gone. Spider was very hungry. 
He was just reaching for the food when Turtle said politely: 
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“Excuse me, my friend. In my country we never eat with our jackets on. Take 
off your jacket so that we can get down to business.” 

Turtle took a great mouthful of food and started chewing. In a few minutes there 
wouldn’t be anything left. Spider was aching all over with hunger. Turtle took another 
mouthful. So Spider wriggled out of his coat and grabbed at the food. But without the 
pebbles he was so light again that he popped right up to the top of the water. 

People always say that one good meal deserves another. 



Harold Courlander: “Hungry Spider and the Turtle**, 
from The Cow-Tail Switch and Other West African Stories. 
Copyright © 1987 by Henry Holt and Company, Inc. 
Reprinted by permission of the publisher. 
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APPENDIX C 



Setting the Achievement Levels 



Setting achievement levels is a test-centered method for setting standards on the 
NAEP assessment that identifies what students should know and should be able to do. 
The method depends on securing and summarizing a set of judgmental ratings of 
expectations for student educational performance on the items comprising the NAEP 
reading assessment. The NAEP proficiency scale is a numerical index of students’ 
performance in reading ranging from 0 to 500. The three achievement levels — Basic, 
Proficient, and Advanced — are mapped onto the scale for each grade level assessed. 

In developing the threshold values for the levels, a broadly constituted panel of 
judges — including teachers (55 percent), non-teacher educators (15 percent), and the 
general public (non-educators) 1 (30 percent) — rated a grade-specific item pool using 
the Board’s policy definitions for Basic, Proficient, and Advanced. The policy 
definitions were operationalized by the judges in terms of specific reading skills, 
knowledge, and behaviors that were judged to be appropriate expectations for students 
in each grade, and were in accordance with the current reading assessment framework. 
The policy definitions are as follows: 



This level represents solid academic performance for each grade 
assessed. Students reaching this level have demonstrated competency 
over challenging subject matter including subject-matter knowledge, 
application of such knowledge to real world situations, and analytical 
skills appropriate to the subject matter. 



This higher level signifies superior performance beyond proficient 
grade -level mastery at grades 4, 8, and 12. 

The judges’ operationalized definitions were incorporated into lists of descriptors 
that represented what borderline students should be able to do at each of the policy 
levels. The purpose of having panelists develop their own operational definitions of the 
achievement levels was to ensure that all panelists would have a common understanding 
of borderline performances and a common set of content-based referents to use during 
the item-rating process. 

1 Non-educators represented business, labor, government service, parents, and the general public. 
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This level denotes partial mastery of the prerequisite knowledge and 
skills that are fundamental for proficient work at each grade. 
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For the multiple-choice (MC) and short constructed-response (SCR) items that 
were scored correct/incorrect, the judges (22 at grade 4) each rated half of the items in 
the NAEP pool. These items were rated in terms of the expected probability that a 
student at a borderline achievement level would answer the item correctly, based on the 
judges’ operationalization of the policy definitions and the factors that influence item 
difficulty. To assist the judges in generating consistently-scaled ratings, the rating 
process was repeated twice, with feedback. Information on consistency among different 
judges and on the difficulty of each item 2 was included in the first repetition (round 2), 
while information on consistency within each judge’s set of ratings was included in the 
second repetition (round 3). The third round of ratings permitted the judges to discuss 
their ratings among themselves to resolve problematic ratings. The mean final rating 
of the judges aggregated across MC and SCR items yielded the threshold values for 
these items in the percent correct metric. These cut scores were then mapped onto the 
NAEP scale (which is defined and scored using item response theory, rather than percent 
correct). For extended constructed-response (ECR) items, judges were asked to select 
student papers that exemplified performance at the cutpoint of each achievement level. 
Then for each achievement level, the mean of the scores assigned to the selected papers 
was mapped onto the NAEP scale in a manner similar to that used for the items scored 
correct/incorrect. The final cut score for each achievement level was a weighted average 
of the cut score for the MC and SCR items and the cut score for the ECR items, with 
the weights being proportional to the information supplied by the two classes of items. 
The judges ratings, in both metrics, and their associated errors of measurement are 
shown below. 
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TABLE C.1 

Cutpoints for Achievement Levels at Grade 4 



llgllg 


Correct|! MC & SCR 

mum** • 


Mean Paper 
|Rating :-r. ECR 


Scale Score* 


Standard 
Error of 
j Scale 


Basic 


38 


2.72 


208 


3.6 


Proficient 


62 


3.14 


238 


1.4 


Advanced 


80 


3.48 


268 


6.1 



* Scale score is deri ved from a weighted average of the mean percent correct (for MC and SCR items) and the mean paper 
rating for the ECR items after both were mapped onto the NAEP scale. 

** The standard error of the scale score is estimated from the difference in mean scale scores for the two equivalent 
subgroups of judges. 
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Item difficulty estimates were based on a preliminary, partial set of responses to the national assessment. 
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Revised Achievement Levels Cut Scores and Student Performance Estimates 

The revised achievement levels cut scores and the revised percentage of students 
at or above each level for both 1992 and 1994 are presented in Chapter 3. These new 
estimates were required when it was discovered that there was an error in the program 
used to develop the levels. In deriving the final levels, panelists’ ratings for the 
multiple-choice and constructed-response items were combined to obtain an overall 
rating for the items. This combination was weighted according to the amount of 
information provided by each type of item, that is, some items “count more” toward the 
overall cut scores than others. The weighting was carried out incorrectly, thus resulting 
in the erroneous estimates in the NAEP 1992 Reading Report Card, the NAEP 1992 state 
reading reports, and the NAEP 1994 Reading: A First Look report. 

The process for developing the levels in 1992 remains unchanged and is accurately 
described in this Appendix, except for the step for deriving the final cut scores using a 
weighted average of the mean percent correct (for MC and SCR items) and the mean 
paper rating for the ECR items. The data in Chapter 3 have been corrected to reflect 
the correct weighting procedure, as has Table C.l, which displays the new cut scores. 

Achievement Level Exemplar Items 

The purpose of providing exemplar exercises is to provide readers with a sample 
of the kind of skills and knowledge that students reaching the achievement levels are 
likely to be able to respond to successfully. They are meant also to represent the kind 
of knowledge and skills embodied in the reading framework. 

The selection of exemplar items for the 1994 reading assessment augment the 1992 
exemplars by providing three additional passages (one for each grade level) and 13 
additional exercises associated with the passages. The choice was made on the basis 
of criteria similar to those used in 1992, 3 with one additional selection criterion, namely, 
item format. Since the percent of constructed-response items increased by 
approximately 10% over the 1992 assessment, the choice of 1994 exemplars reflects this 
focus. 

It should be noted that although some exemplars are associated with performance 
data from the 1992 and 1994 assessments (overall and conditional p- values), others have 
only 1992 performance estimates since they were released items in 1992 and not 
readministered in 1994. However, they are all reflective of the assessment framework. 

In Chapter 3, Figure 3.1 provides the final description of the three achievement 
levels for grade 4. Exemplar items, illustrating what students at each level should know 
and be able to do, are included in Chapter 3 as well. The descriptions of the levels apply 
to the framework that underlies the 1992 and 1994 NAEP reading assessments. The 
exemplar items reflective of the levels have been updated to reflect both the 1992 and 
1994 item pools. Table 3.1 in Chapter 3 provides the percentage of students at or above 
each of the three levels and the percentage of students below the Basic level. 



3 In 1992, both statistical and content criteria were used by the panelists in selecting the best exemplars from the released 
item pool. A description of this process can be found in Appendix C of the 1992 state reports and in the Technical 
Report of the 1992 NAEP Trial State Assessment Program. 
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Reading “Revisit” Study 

American College Testing, the NAEP standard-setting contractor, conducted a 
study to examine the congruence between the reading performance and the descriptions 
of reading performance embodied in the levels, within the context of the reading 
assessment framework. The purpose of the study was not to set new levels, nor was it 
to develop new achievement level descriptions. Rather, the “revisit” was designed to 
evaluate the descriptions of the 1992 achievement levels with respect to their 
appropriateness vis-a-vis student performance on the NAEP. Two methodologies were 
used: (1) evaluation of the achievement level descriptions via statistical item mappings; 
and (2) evaluation of the descriptions via judgmental item mappings. 

In the first procedure the NAEP exercises were classified according to the 
probability of a correct response at selected points on the NAEP scale. One half of the 
panelists then examined the items falling into each category to judge whether the 
exercise content corresponded to the descriptions of those levels. In the second 
procedure, the other half of the panelists were asked to classify each exercise as Basic, 
Proficient, or Advanced according to whether the item matched the description for the 
level. Once all the items were classified by all panelists, they were asked to evaluate 
the extent to which the descriptors represented the skills and knowledge covered by the 
assessment. 

After both an independent and a joint evaluation of the descriptors by panelists in 
both groups to determine whether the 1992 descriptors were appropriate for reporting 
performance on the 1994 NAEP reading assessment, the panelists were asked to 
recommend specific changes in the descriptors. Based on the findings of this study, it 
was the consensus of the participants that the descriptors used in 1992 were, in general, 
appropriate and consistent with the NAEP Reading Framework and the 1994 NAEP 
reading assessment results. However, the panelists recommended minor modifications 
in the descriptors. Their recommendations are reflected in the 1994 Student Performance 
Level descriptors. 
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APPENDIX D 



Data Appendix 

For each of the tables in Part Three that presents reading proficiency results, this 
appendix contains corresponding data for each level of the four reporting subpopulations 
— race/ethnicity, type of location, parents’ education level, and gender. 
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TABLE D5.2 

Public School Teachers’ Reports on Time Spent 
Teaching Reading 



1994 Trial State Assessment 


45 Minutes or Less 


60 Minutes 


90 Minutes or More 




1994 






Percentage and Proficiency 




TOTAL 


ji ' vv t* '■ 






State 


3.3) ' * : 


43 ( 3.3) 


6(1.4) 






\ 12\3{.2AI X' L ' 


’* *%i *£ : : »)6 ( 3.3)! g ^ 


Nation 


’ , ' : 37 




19(1.9) 






|t||| 


. 200(4.0) ; 


RACE/ ETHNICFTY 




[iTlijss I I'^hI 


White 


>•! -ft ] ;Ji r.[ : : : : 1 r ' 8 * * r a * ^ 


: ’l: 1 1 *'■' ’’t •?' 




State 


-Vi;;; ' 51 (3.3)'< > * . 




V 6(i.s) ' 


Nation 


■:;jfS'i s -^ ! 218 ( € i . sra 


: i i :sn< li- n?tNiHpl:iy 


5 209(3.0)!' ; i-x: . 


:: ; 39{3.o)\ : ‘ ' ' 


S|!l| [ ip IJ: |49.|'3J2!)1li L v: ?4 1 


^C!^§"!ir.12(r2:i)^' 


Black 


223 ( as) i 


;|p[Mp!:^223 (-1.9) ;,!/ j ; . 


221 ( 3.3)'^ : ;\ 




& A ^ s'" - ♦ ’ “1 * y *. v 4 'jir 




State 




■IMilllSSiliilliiB f .> ^ 


3 (:1;6j^lv ' ' 




tatenru;'.;. * 


j::?:!;,; -j. j: | : ;j . ;. .ytf ® :^:; i ::5 




Nation 




r ;26{4L6) V ; 




Hispanic 


ifi&DilSiS ; isi ( 3.1)/. » v ‘ 


191 ( 2.6) 


.r : 4'^ r 180,(:2.9)' V « ! ' 


i!" 1i i ' v ^j4 (\? Hs M=^ / v f ‘ 


l ' S; ' ' . J y'*l >' , ;.f: /' •" 'i !! = 1 


^ 


State 


di - 44 (-5.8) 11 81 H 


ii r^( S/7)1;ifi| % .ri 1 


;: 7 ;< 3$^':;^: ; 




am ii 


192 


IllfirlllS ;W'I 


Nation 

Asian 


30;(’4.2) j.-f s ;'-- •«* 
, ;-'t - 19i ; <4.5>’ !;■ 


/48{‘<»r^r 

^i#i|pi93: <p2;7)0gH ; :* . f 


r 184(4.8);,, ' 


' < ' ' v ' ' ' 'i ' *■; 


I 1 !: ' ' j. 1 ! ;=' f \ '•* - ’\V vii- 


? 7* ; " >.' ' / s n •; 3 1 ; ; ' •; 


State 


| ^ 61 ( 8.1) , 7 • i 


lliSIII; 3S;(;9^||llE®|iSi^ 


77%‘i’i 7(3.6) ! h-:.^ 










Nation 


|:*-t ^ 


1} i ~:*M£i 38 rfM 


28 ( 7.2) 




mm 


i»l*iSi{|S|Wi . till 




Pacific Islander 


><&;>- y '-L •£ PS 'J 




^ P P 1 xK-'- r ' > 

f( . , t. 3.9) 


State 




lijsisyi27[<i®8j!i - : j 




. ' ■ *** £** *^ : : 




! ' H 


Nation 


8.9) ; , i - i P 


S«“ >l|n 


: / r:f ' Elii 




:ik% \ i < <*** s’ »s* , ' - T'C' 


HIIIlT^ ' k 


| ||j|| | **f (**•!),: 1 || |gl| 


American Indian 


t ,/v* ?; 4' 'i' r 






State 


WMW$^%SS) I* i r 

tigji f >|fl 


48 ( 7.3) 


9(3.4) 


Nation 




r. 4*S< --40(S3)’f - s . 


/ 7 ? £ IB ( s 4£) > >> 




^ V ; 'A' 1 *? (»* •) j ? <*' * - ^ 






TYPE OF 


Pgg; * "V.j ■. | •• j i J -t; •’ ’v” : ’• * S| •. >*S 






LOCATION 


^ ' v f i , ^ <s< - 1 


.. . • . . •- : : ’ i ' : . . : ; . i 




Central City 


i-ii: ■ i: : - ; : 


'4 r .% | 


r.!| . p /u„ .'>/y ' , ''( "'t 7‘1 7.7%' 7 ?%' 7 '. / 


State 


111!®! i5H4^ BA)" *' ' - ‘ ^ 


< r ' ; 4- '37(5.7) ft 1 ||P 






214 { 3.6)! 


|ii!|ii|8l&2i(:'3^) , s| ?, t 5 




Nation 




i Util 


Iliillilii27:(i'3i2)lll 


Urb Fmg/Lrg Town 




'208,c( ; 2J3) 4 4 




: -v W >•■ |i 0 ' Us i! 


iBii ii^ { - - ■ / pi i r ; 




State 


< 43jri ^ 45 > P5 


if; r : x ; 45 (' 43 ) - 


K13 tl i'lfi 


Nation 


J;:p;?216^2.5yw*'N; ^ ^ 


aild) ^ 










Rural/Small Town 


vx- ^ 


ft|l4|^2224 t C2;3^ * V. t r" 


WSsW$ 


5 !^Sfe:41ii : ! Si : itf% . ^r; 


* ' ^ ^ ; ; ' v ~ T- >' ^ 's T t^l'v 




State 


iplli WM. 






Nation 




iii|ip«#^T4l(5K7)l • -*■ , - ; 


.}. ;?:;: ; ;i jj;^: ,"i #•::<; X 


!'<Ln:,:';;v43(6.o) 




r '7~$ i ! " : -'7:7 /-.I/;; ;9 (<3.7) ;.x ;> 








^ 1 p ? j u |p;|!9p 7.1)1" g H g pL|| : 



(continued on next page) 




i 

X 



4 



j 



124 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Washington 



THE NATION’S 
REPORT 



CARD 



rsaefi 




TABLE D5-2 (continued) 

Public School Teachers’ Reports on Time Spent 
Teaching Reading 



1994 Trial State Assessment 


45 Minutes or Less 


60 Minutes 


90 Minutes or More 




1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D5.3 



Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 
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TABLE D5.3 (continued) 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial Stale Assessment 


Primarily Basal 


Primarily Trade 
Books 


Both Basal and 
Trade Books 


Other 


1994 






Percentage and Proficiency 
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(continued on next page) 
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TABLE D6.1 (continued) 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Tnal State Assessment 


Primarily Basal 


Primarily Trade 
Books 


Both Basal and 
Trade Books 


Other 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2A 

Public School Teachers’ Reports on the Frequency of 
Using Children’s Newspapers and/or Magazines 



1994 Trial Stale Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 








1994 




TOTAL 


ftOyftp r I , 


:r r , 


Percentage and Proficiency 
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TABLE D6.2A (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Children’s Newspapers and/or Magazines 



1994 Trial State Assessment 
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Never or Hardly Ever 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2B 

Public School Teachers’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 
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Black 
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American Indian 
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TYPE OF 
LOCATION 
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Nation 
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Public School Teachers ’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1994 










Percentage and Proficiency 
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8li| if 
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; Lb! i! ' 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2C 

Public School Teachers’ Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial State Assessment 












At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1994 










Percentage and Proficiency 
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White 

State 


^ ’ * 


; 19(2.3) : 


vS s' ; 


|64' < 3^) 
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\y^i222(lJ&) K'fi:/ y 


Black 


V'^5 v : js y ( x x ' * 
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State 
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I illilpp {'3:8) if;SJ£ 




mmmswp ’ siisiii 






V ; 201 {2:3 


Urt> Frng/Lrg Town 


!■''* ^ . .a < s 


•, . .' r ; . i .-j. 
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TABLE D6.2C (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial Stale Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 






1994 




PARENTS’ 


r. -■ ■ 


Percentage and Proficiency 
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litil lllil 


1230 {AS) - ' © !|i 




Nation 




Hill 1 • p| I|23f{ i3i0) ; C “ v > 


i Hifi ii- 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2D 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial Slate Assessment 



At Least Once a Week 



Once or Twice a Month 



Never or Hardly Ever 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
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State 

Nation 

Black 

State 

Nation 

Hispanic 
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Asian 
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Pacific Islander 
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LOCATION 
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TABLE D6.2D (continued) 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 






1994 




PARENTS' 


‘P ' b i i i :J 'S\ : : , ; t : iii # 


Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2E 

Public School Teachers’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial Stale Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 






1994 
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29 < 8J6) ' J ? f 


v; : i: 


Nation 


SI!I8iiliaio|-3;a) :.v \MU 
















210 { 45) ; ; ' 


209 ( 5.6)1 'SR'S- 



(continued on next page) 
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TABLE D6.2E (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial Stare Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 






Percentage and Proficiency 




PARENTS’ 


}|| liilllHlill I | || ' W & 3 




V/ 5 /V;;\r ' 5 T 


EDUCATION 


K ,z ~ ' i, i'i j s ;j { ; \ |i j „ . 1 ;; f 




: ; : \ ' ' ,? if* ] ; ; ; i J 1 ( • 


College graduate 






: SM ‘p :: j ? 1 !i : 


State 




V 'i j v ; 21 { 2.3) :i ' f ' : 






Ml .2261 






Nation 




mm 23{2J2) ii 18 ill 






• ' 223 (ii.6):;' . • -p 


Jj§| 224 5 { 2;e)f ” _ 




Some ed after HS 






i; }ijii ]; '? i* !;;>= :: I',- 1 :- 


State 




*3 ,24|{3.3)1'< * ' t' 


i iiiii 




I'iliili ^2t8E3^K; I H 






Nation 


liliill 




& I* ■; d% 




5 i V 5 'n 




• A it 


HS graduate 


!=|iil |= M : ? : 0 y i ;= ii \ 


"■ f- a- : IK'S;.' ?■. t r.'t" si 


State 


1 1 II 1! 70>3 25) v lElflll 








Mil ! : 1 iat2i$2=9);:‘ 1 






Nation 


HI ♦ . 66 (:3i1); 


mmpmmm i2i9)ipif gut 






1 1 1 1| 1| 1 207 : (?2«1)^;'t s l : 1 1 




iiij^i2=@a^g>wwaiga 


HS non-graduate 




\""' r 'y‘ PA«, '' - ' ' ? ,i 




State 


IBWlplepifeli) T?z 








ffiBiiiiliikS 






Nation 










j 1 '191 ( 4*6) I s jjj 




III : s> : IBIIII IIIII 


1 don't know 


||| > '/ v. i" 5=11111 






State 


III |IH|liiil( : i: f 


' K 1 1 : ! :l 2o"if2.4) ' ' * ' : 






V iH ^206 { '1.6),; J*]'# 






Nation 


I lll®ll '\'s 


®iIpiS2C^2^)i|l|1i| A, i 


Ills tcnea MR 




lllliBifeos ift 






GENDER 


' H ' ¥ ' t ? 






Male 




~ ^ * 5 j l ' 'i 




State 


fl ; * 1 1 '''568 !{ 3x0), '■ 


v ;22'C2 x3) j S : 5 : :V : > r ^ 


lli|l# : 8!lllSli(Mi^ ' ‘ — 




ilij) IlfllSHiit fftis) ' • 




' AW 197 <6.0)1 


Nation 




1 v : |i| ? 


i iiiii mmm- 










Female 




w 1 " " £■*' ■»« .4 




State 






mBi 




illll l|!l Plf J=22bi< : 3 ' s ' - ; < 






Nation 


! ul 


hfLiKl M23,(2xl)H^ **« v. 


lliill 1 






• g22^:o):|:4i^3i Vv 


ill ii ,-'2t7<4.5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3A 

Public School Teachers’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






Percentage and Proficiency 




TOTAL 


' ‘‘■'’"jj! VY*>' Y ' v p ' 


tp:- rj'fY:'"; :; “ v . 'ZT'Z ' 


g/- ^r;r;v'-; 


State 


rii 2.5) 


f>J': f ; 1'48 < 3.0) : /ll ^ \ 


5 iY; !' ^'-£Z ! Y •" . 1 ': V •'> • :•* /V 

^::4v#;P35 { 


Nation 


212>3.4)'> ' ? - • 


V^:y( 2i1)/ ' 


- ^I6,(il:7)p:^ >c :i 


| 1 26<2.6)-:!'', • . Jill 




26(2;9)v^:K-: : ''' V P: Hll 


RACE/ ETHNICITY 




^ 2l4'(;.i,4)' 


2i7 < l.9)j^|v;p.pp : i ; 1|j 








White 




il^lSSBlIlBllilfflL^ 1 




State 


17 ; <i25)- 


/|:^r?|47C3:i) 


3© < f ;3i j 


Nation 


217(3.3) 


pp ^:/;^216'(2>1) 


P'^:p5-.ri221 <2.0)PP' r i :k : 


. :;;tiv .‘23(2.8)-'-': < 


49(3.0) 


29(3.4) 


Black 

State 


220 ( 2.3), / *<-.J i\ 


BllllllliSil SiwISvl II M :M ; : 


plglj 224 f2ii)||k£ |4;:; 


II III !|l II 1 1 

i 6 < s.4) < 

3f|| ii I ' 5v »* 1 


! i?U j * 1 ? 01 1 i 7« 

‘ ^ < i. '54X7.7) >' ; . > * ; 

v-?;v Essgff< 4.3)! ' 


-;29 < 5.6) : ;Sfilh-:^feS 


Nation 


38 ( 4.8) 


PtB^nl# 48^344)- vr: ’- r ' 


;>ij s .y^v i4(3.i);::.^;P Pri: 


Hispanic 


‘ t >; , 183 < 2.3) ; * * 


188(2.1) 


f ^v' :;;pj 


State 


|| 1 || If ! ; i6 iililil 111 


49(4.6) 


35 


Nation 




191 (3.9) 


< 5.3)!t;V^;!P: : : PPt 


f ''29 ( 3.3) Sfi ; # 'll ill 


45(4.4) 


B i'yjip'26;:< 3$)'iSllil : > 


Asian 


188 ( 4.6) 


193 ( 3^) :; 


i|lli?|||||1;}ijB8 ( 4.3) pPSfl 


State 


6 ( 3.0) 


1 } M j 1 1 |lSi||ii9) 


44 ( 7.3) 


Nation 


lllil 17 ( 4.6) * < € + 


8 H 1 ^plilSis) ii ? # */: 


'-I cr^5 ^ V<M ?* (**'*) ' 

■!H!SlP^< ^llllllill 


Pacific Islander 


:|-i : : jj : S 1 £♦» -^** ;: *^ lj $ | 


lg|23l;i<|ll5)i ' - > \ I 


. . ; lP> p % *+* (*^7) 5 


7 ^ : - ! ! & ^ , ! &! j;;i / ^:.V . ji: r • - : : v\ : J f* iiii 


■ . ■ . : : ■ 


State 


•l- 11(5.7) I 


^ ^ ;|^||&K7-5) * 


37 ( 8.2) 


Nation 




feir> 


1 lilii mw®m s ' Bill 


! lllliliiTili;; ® 








>-r 1 


g|H^ III 




American Indian 






State 


I nil 26<6.7) v > ; 


i§if 524 : 7 $) ? " * t j 


'' ^'1 ‘‘22 < 6;0) ^ 4 


Nation 


zr l .I^r; 


: s p:,r| ££&*:•) # igii >/' 






> : il^'1r? : <4>45;{ 4$) ^:| ill; 

^ 1 j , ' / ' ' - 


giiliill .. 27 i(i^#iiBiiift8 




iiiiliis 




TYPE OF 


*$£ 9 3 . 4 * v }£. • • / * ✓ < > 


^ ^ v,<s ' . ' y r <? ,5 




LOCATION 


, "r* "/* . v „/> 


^ * '' J / s ' Vl' y 'pY - 


^|llNp::S •' i ^ IH liiliPt ¥ PSI 


Central City 




||| ' ^ « 1 % 4 >;* « < - 




State 


liiiilll 4ll;V 


;#.iiB3Hi46;( 55 )-Bi?' v S- 1 | 


•'/ V\i4. ; 39 ( 5.0) i s ' . 1 ./ 


Nation 






i a i iS '.215 ( 34i:y m«i 


* < - - 


5 v >.♦ -45K 3.9) • -< Tj*;« 




Urb Frng/Lrg Town 


BJII ; iiir 


iai«fip 8 j( 2 ^ 






/ i , 4 ./' . jj .. . ..^ y < 




State 


|i|ll!!ll!fBW;^3^j| ) ; M ft S £ 


liiiiiiiWiSKPiir ; 


.'St'e ( «i) / v 7c. 

p^JSSPnsi: ( 25 ) 1W8#I |« 


Nation 


iiilil! 1209 ('4^)ilil!;!4|!fr|3^.r 


: ■>-„ ,''213;( 25) L..Y 




fgiiBPiaSKii^aii:: • ^ Y 




Rural/Small Town 




liilllllP S f > nn 


-224 { 25) | 


State 


las si 


1 : •’"«'( 75 ) I. .' 


V>v“?;iy • 23 ( s!i) lift if 


Nation 


ipiiffiPPi 222 ( 4^!fflH=9 .' W 


208 (.5.7)! 




v : --n 5=1 Sl:l;23 ( 


Li'!; 5f( ei): ~ ■ %a!§ 


i YgqititW 20 




^iipap^2c(sii4)i i? ;> 4 ''V r 


IlSiMlzi s|(12^)hS 


: ;^:iiijso2i2(«4i4)iay ; ■«:??<•$* 
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TABLE D6.3A (continued) 

Public School Teachers ’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial Slate Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






Percentage and Proficiency 












PARENTS' 


mvihhmi A % 




v jv ; n \ ^ ^ }*a 


EDUCATION 




1 r | i |j ** y !jil 1 ^ P j 1* » r j | 


l :/(, 1 '* ' t i s '4 ' - ^ ; 


College graduate 


*\ t l A- " 


ft i 46 ( 3.2) -V !h: ;1B|i 


" ? ,*.? ) '} 4l J !; * - j'\! . T : ' 


State 


■: '• ... 17(2.7). . SlSI 


f , i : J37 ( 3.0) - , . 




' . 1 222 ( 3.7).- }... ; 


ip HP 222(2,3) :} iilllfii 


• v-i^as)*?-' 


Nation 


MENS 24(2.9)''-.':"*; ; ! "■ 


piiillliii8i(i:3.0) ! ^ * c 






' ---j ^215;(:3.2) > ' r f 


^ 1 ' , ' 1 




Some ed after HS 




i 1 £1* ;N;i : rV'? : f . Y % * 'FfeH* 


' : v): i 1 : : 1 : : :: ^ | j ^ j i !,fe %::(j i: 


State 


i&wMm&mmm&u 




1 ) 'S^fcyi - ; i r-; 






U * f ? : I215f3.1) ; 


r2l'4T4.3), 


Nation 


iiim 220 < 5 $ ,*h , , - ' 


n ; i4^(-3.8) .'if.vSV 8i|| 
^ <4 * j; 225(2*8) : Y, 


=' : !||32: {! ii>||l IIBSIBi 
. * % & ? % 21 9 (4:3); t if) ' i *; 


HS graduate 


IlifeliSiSiii t - 




, : s - Pi ' ! s' 1 J 


State 














Nation 


II 111 | 32/(-3.6). f| § p W 


iMStW?30Fpt6)' illSillSl 




lapiftlifoE ( 3.6) . . 






HS non-graduate 




^:|;n iii!;;-?; fk AMk. k fi% ; «s i<; 




State 


iilllMillli 1 


l-'-L:;-' 1 ' :59( 7^;-? t ! 


Hilfil#ii29SPiO) ' ■ ■ |^i| 




SUMM; ''-Af'fj 


lit ! T* CT*)'; 




Nation 




v«~' ;; ■' *49(;4s) . . 






Killiiiiayc 5.9)1 


’ '„K ? '• >' ^ < 55); ; 




1 don’t know 


^ ;s <5^^ '^A' " 5 V^, i ; (' 1,-; 




State 


;f f ’. 11 










: 203 




Nation 




:1 st ' {'2 jM ^ > 5 r 








2 20S<'^). Illlill 


mmmmh 


GENDER 


; \ ‘ ' < ' s> ? * “ * ' * <s ' - 




j Jip| : ffs : K; ||| 1 1 : 


Male 






.yA v '-'/^ s)r '' ' / ''H x" ” 


State 


llllllilflIKB (!2J5) : ; 










209 ( 2.5) 1 f 




Nation 










iiiffiilsii ttlillifll 


208( 1.6) 




Female 




-Srr%''* -V|: ^J-.VTr sj 




State 


>Y III 


:':-47 : ■- .‘.O 








216(2.6) 




Nation 




' 49 (j^sBw^S II 


(Mill | .V2$;{’3.i) | lllftBill 




3jop4f L V 







The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3B 

Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Trial Stale Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 






1994 




TOTAL 




Percentage and Proficiency 




State 


i®§ u* &**. 


llillsi®.o) .iBpi 




Nation 




^ : 214 (2.T) s « 


\ > 

; ' ' ' 24 (T^) „ | • f * " 


RACE/ ETHNICITY 


1.3) || 


5&1 &) '*'* ' » 


:^;:X V 203(|;9^V\ ; ' • 


White 


lllliSI 8|f y i; - Xr \ 






State 


1 ij V f!f 43 ( 1.6) 


|illilii8pS):i 5 / < 


ii 1 ?"' iillrf 5I : : 29 HiJ 1: 5 1# r ;R?: 


Nation 


' sm 


1 IS f 219<2£);. 6|ii;i 
■* > ,/ _ ,25(1.2) ‘ Jiiift 


- '^0 . 216(^4)': >/ # M 


Black 




v23i ‘ -'Jfci .? r £^.jj||£ 


; \r%*; \: 3^2^) s )* y liy: 


State 




*Vfe -■ '22 {'3.9) ; ''*< 1 




Nation 


' p 198 < 3.6) ' 


Sftiill#S^(S?) 1 


f" ;'£v-^rr^) 

^^oli ?=' .k^;23X:1^'1 ' ^ i i ifi 


Hispanic 


4193X2.1) s p f| 


.: <,r> c 187(,3?l) f; ||| 




State 


liilllliliiiU) 1 : "i- 


• ! f; 3SJ hiiS "V* - 5 ; ; * 




Nation 


Hfpfj 




192{6i^l!g^!li?Sfr 
* i^) £3® 


Asian 


19602} > <* ;; 






State 


^ ' 39(54) < > 




:# ? f /; V l| 


Nation 


:/r';47^ae) 1 


wisxki/w 

"Tv is ii':-;; i T*i*rX*" ■ < *) : -- ■ V 




Pacific Islander 


!i!iiiW§i»« i iiiiiii 




State 


1 41 ( 7.9) S|||l| 


if tr$. ; fei ? i;7-3) v 


28 < 6 Jfllillllll 


Nation 








American Indian 






*r; 


State 




' : 23 <3.9) 


ili!|i : , , 3i:i»IS«l!!I# 


Nation 


f|§ • 2 mcii Mi 

iliIiliPS0;(^4«7)' / i4t'n 




♦<r* 

lilS»i»iiS8«illS* 


TYPE OF 


■li!|||| j|°9 ( 5.3) ; ■ ;; 


iHrtk; {** 


• 'V i i *'i^j «" j|^- : ? i;: :;|;i 


LOCATION 




\ 1‘Qj > *£& \ : i >|> i 1 - : /' j, c ' j j . . ; ■ 




Central City 


- v Jr^c * ^ ' vv*?? s •? i ( 4 


: ^ 




State 


Hill 1 40 ( zrf\ #11 Mil 


; 28(1.8) ilpB* 




Nation 


; ::i : 4= £ Hf/R 


®i§^®2ll3(4iP) N iiglpill 

\0MW 


H| B'-;210 ( 4.4) 

iBiiii • WHttmHmn 


Urb Fmg/Lrg Town 


BlSilil 10 C i§4)jj|y:fffl|l|S| 


' j 2o^^mipi 


SIIIMIlSill* 


State 


if ittW&M WIR 


29(1.5) 


28(1.9) ' 


Nation 


iilliliiiSliB (2.2) KpMR 

IlSIllliSSb^S^ 111 1 


Tiy+f W^M 


i f i|i iiS! (ii) ! igiipi i 

^)9 ( 2.7) 


Rural/Small Town 


|S1|||;|;225.( 2.0) P®|i|i||S 




State 


^ : 


26(1.8) 


■ ■ ' 24(2.6) 


Nation 


i |8| ' 




^ zo4 i { 4^ : . 






;* i ^ ^ 24 x &g) ' ; j: ^ * # * 








201 { 3.6) : 



(continued on next page) 
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TABLE D6.3B (continued) 

Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


.“niiwii 2.0);SES||;' 

41 ( 3.8) 

IIP £ 218 ( 2.9) ; V ' i W 

iv;48 : {:3;1):r b Z ' ; i \ 

227(2.8) ; fc V* 

1 3i 1 III 18 1 ill lllllf i*V : ' 1: % 

\ (3:1); -V 'C; 

: V Jii:, J^213<3.6) i ± : 

it iiilliii { .53 ( 2.4) ; ***; ' 

2l4/{ 2J®V-'.v5 > |r \fj 

filllllSiiiilJo) J r - 
r. 

''\4 

47 X t&) ' " v 

211 ( 1,7) ; 

iliiSlIf :|43 (?M liH 

|^^|i^i5(i^ , >v 

>1 v > r 

plil ^ r 


Percentage and Proficiency 

IIIBSiiliiil^llSSBIIIl 

il!illi|g223:( :2^l5i!iili | 

26(3.0) 

jjlggiji f 223 , < 3i) IBlflif If I 

\* ^lV 211(5.3) k\ 

. ^ ‘ 25('i.e y - t; t*' 1 

lift-/!. H 1* 1 JSIlSl 

r >raB(1.6) ? \ V*-; 
V- ? 2QC&JQi'." *' if 
iaiilpii 27(i o) hiipiiii 

,V| f '4; 1 lJ > * ; v { l 

l>y ^27 Hi)' 
ipnos 

ifliiflH 208 (^sfiiiiiii 
Ml ;lft 

1 || rfi; 220(:2.6)^i;, s ^C 1 
: 2$.<N;i)V¥ll-VI : f # 
' i ife f . s ^:'* 1 


~l i; ;• • . 'y ■ ? b- \« : / 

M$'X, ! >.-h -^V'4 

;iv; pi 

28 { 2.0) 

'■■ vV : AfV< 23 { J. v . ; 

31(3.1) 

21 1 ( 4.7) 

4?>3J'v 216 ( 4.0) 

- (**•') 

iBSiili *;23, { 2.0) Si • sin 
193(3.7) ’ 

IE 

/ ' : ^ : ' ' v . : j- ' Sy' . 

it liMllli Jillll 

■ ■ - 
U Vs V *5 b"' ? "tj ^ -/ 

:>. 209(2.6).| id <gm 

; i' ~:-w 

: afotl’.o) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3C 

Public School Teachers’ Reports on Asking Students 
to Write About Something They Have Read 



1994 Tnal State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


TOTAL 

State 

Nation 

RACE f ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 
State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


:>>•$?}&: v.vj.y.x.** v*** v.-: .V 

216 

> 30{2:4p> '"*V‘ 

32(3.1) : 

'; ! i; * ' 22 i < 2 .o) . ' . . 

Si!8!ilii3c|#i.9) 

;|| ' 221 { 2.3)’ (7 : , j V 

S3$j.O) 

. ~ cm 

, 28;(4^-- ; ”-r • 

/■ ti%h P/il 1i 1 

811 ;'30(3.i)h 

35 ( S.9) 

j :r38(6-6), '• £& 

iisiiiMiiiiiiii 

- iff 

Sratifrr - 

44(83)' f# y-v!‘, 

; s'S)^ fig ‘ " 0++ ' -f ■■ '5 ;Hl ! | 

II- HHflHWi 

, ' > r , 

" P * 34{'6.9)r./. v/ : 

r¥|- .: 7 / 

||ffp 

^ ^ t 

liSeti f f &tg *i3’br ; it ISf- BH 

;4^ -?&»<*«? \ * 

Bli. rl-k:216 < 3.9)1 j JM fh 
213 ( 4.7) 


Percentage and Proficiency 

BlBlilHilllll 

l:®iKfi|i:56(2.3rf!^^ - 

■■llillllli! 

-' fi 55 ( 3.0)1 '.'.X 
a ;2i 7 ( i.8) ' - i 1 

56 (2.6),; »;! ? 

11'* '67-;( : 4!o) M '• : ,V ; - 

: ' (Hi . :5s { 4.8) : lil 881 

| a:, ,'^85(2.4) 

x'SL : 

-,-192(43);.' ; 

■ipim. 57 ( 4.1) : j;-'.'- • 

r';i ' r ' 190 < 2.4)^' 2 , 

■ ; 49 ( 9.7)',®; ’ J - ; 

Mil: 77 ?. 235 ( 8.6) |l§g§ 'f 7S 

' ^ ‘ v ' 

i/46^8.4)l ^ 1 s 7 ' 
| |j {*♦ *) | ' || f p:;: |j| 

'so (.43)-. , : ] 

,;."|^'.;.JI99( : 5.7)''.';; 

... “-59 ( 62) , , 

flMj ■ r.61-{ 3:8} ’'-i -a...:: ", 
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TABLE D6.3C (continued) 

Public School Teachers’ Reports on Asking Students 
to Write About Something They Have Read 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS' 



EDUCATION 



College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



Male 






'i : 

v *i : ? ‘ :: : * 

: 33 ( 3 . 5 ) ? 
::.v r • 227 ( 2 . 5 ) 
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31 ( 5 . 0 ) 
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: 219 ( 5 . 5 ) 
::11, 1,1.8) 
225 ( 3 . 9 ) 
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225 ( 4 . 6 ) 
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lliiip); 11 
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ipPliPil 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3D 

Public School Students’ Reports on Writing About 
Something They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 






1994 




TOTAL 




Percentage and Proficiency 




State 
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li ?iC^ -j 1 47(1.3) . 
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TABLE D6.3D (continued) 

Public School Students’ Reports on Writing About 
Something They Have Read 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



Percentage and Proficiency 



PARENTS’ 


;rpprr:^ ~ ~ 


v * ; r?;. 


‘ TTT ; 


EDUCATION 




liillililSpBllilllili 




College graduate 


fjxi* 7— f' * ' r S K '- ' 
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State 
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' %3S (3.3)*' f ; > : 
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|i || pi 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4A 

Public School Teachers’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 




Percentage and Proficiency 
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RACE/ ETHNICfTY 
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Nation 
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TABLE D6.4A (continued) 

Public School Teachers’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4B 

Public School Students ’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






Percentage and Proficiency 
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TABLE D6.4B (continued) 

Public School Students ’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS' 

EDUCATION 



College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4C 

Public School Teachers’ Reports on Asking Students 
to Talk With Each Other About What They Have Read 



1994 Trial Stale Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 








1994 






TOTAL 




Percentage and Proficiency 
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TABLE D6.4C (continued) 

Public School Teachers’ Reports on Asking Students 
to Talk With Each Other About What They Have Read 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

i don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



,35(3.6} 

225 ( 2.3) ~ ri 
■ Ufl36 ( 2.9) •; V II 

■Jtg 2 A\Z 3 ) / . j j 
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Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4D 

Public School Students’ Reports on Talking With Each 
Other About What They Have Read 



1994 Trial Stale Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 




Percentage and Proficiency 
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RACE/ ETHNICITY 
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Black 
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Hispanic 
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Pacific Islander 
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TYPE OF 
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Central City 

State 
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TABLE D6.4D (continued) 

Public School Students’ Reports on Talking With Each 
Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 






1994 








Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4E 

Public School Teachers’ Reports on Asking Students 
to Do a Group Activity or Project About What They 
Have Read 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 











Percentage and Proficiency 
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TABLE D6.4E (continued) 

Public School Teachers’ Reports on Asking Students 
to Do a Group Activity or Project About What They 
Have Read 





Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 






Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses, It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Public School Students’ Reports on Doing a Group 
Activity or Project About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 






1994 
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TABLE D6.4F (continued) 

Public School Students’ Reports on Doing a Group 
Activity or Project About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5A 

Public School Teachers’ Reports on Asking Students 
to Read Aloud 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



Percentage and Proficiency 
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RACE/ ETHNICITY 
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TABLE D6.5A (continued) 

Public School Teachers ’ Reports on Asking Students 
to Read Aloud 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 
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EDUCATION 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5B 

Public School Students ’ Reports on Reading Aloud 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 
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State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 
State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 



Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 



(continued on next page) 
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TABLE D6.5B (continued) 

Public School Students’ Reports on Reading Aloud 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 




Percentage and Proficiency 
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; , ■' ; y \ ( 




• • • fk : C 
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Some ed after HS 
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•1 '-iS j , ”> B '->< J «. 
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^ 4 ? • \ -< ■' 't { . 
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1 don't know 






1'>: ' •> - . . V '.> ' • ^ 'J « 
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' - . ),l: ' : . ■ ’ . 43 ( 1 Aft 
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: 202 ( 2.3) 
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“ <.* ' * * \ - '< 4 
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t : ‘ 32(1.3) Il ^ l:|| 
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' i. Z ' 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5C 

Public School Teachers’ Reports on Asking Students 
to Read Silently 



1994 Tnal State Assessment 


Almost Every Day 




At Least Once a Week 


Less than Weekly 










1994 




TOTAL 






Percentage and Proficiency 




State 




;7;; ; ■.;/ 


\ ' • 


1 1 




Nation 
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TABLE D6.5C (continued) 

Public School Teachers’ Reports on Asking Students 
to Read Silently 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



l!Kp 8 )M 
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; 211 ^2^8) 

fMwm 

208|2,1);: 

84 ( 6 . 0 ) 

mK&ar:*. 
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: 202(1.3) 



Percentage and Proficiency 
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j|fg||| 8 )]i 

Bii mi 

i§Ili<Silit 
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||| 
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^mrP : \r'w. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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1994 Trial State Assessment 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 
State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 
State 

Nation 

Rural/Small Town 

State 

Nation 



TABLE D6.5D 

Public School Students’ Reports on Reading Silently 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 
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K^Sfteit 2 . 0 yiT- w 

lil2^03Ea)II 



i^iMIW:85:ipS)ii|l 

■188(18). 

‘r; -i 

»•) '.p%'5/jM92 ( 4.7)"'' . 

>';> - - i. -12(0.6)^ 

fecX:: ; ';.;l9%aS):. ! 



•%Wi 

■ fit. /"Uif-'i- 3 )'*-' ” s 

169(3.5) 

' n: 

IISIII RlSilll 

iilli! : >'*r*(**:n Pil 1 

IBlllllliliilll 

J rh' ^ - 14,;( 4.3) i '; ■"- 

pi '"<•'-*) ; • 

iWHfegrc^ 

.::> -t8-( 38) ..gill 

1 ? ^ I 

|fs? : fr # * j v ' ii; ; ; V': : v1lll 



' v i ! 
x'V ! 



■' v ‘ll!Wn^(.9^it>ir 



^wStCtftrf ix)) 

193(4.6)Vf 

>i95 y (4iiy';i-x' ij 

” >! 

WHp^tlN88 ( : 37) r- 






(continued on next page) 



16 



166 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Washington 



THE NATION’S 
REPORT 



CARD 



rcaep 



m 



TABLE D6.5D (continued) 

Public School Students’ Reports on Reading Silently 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS’ 

EDUCATION 



College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 



Male 

State 

Nation 

Female 

State 

Nation 



Percentage and Proficiency 
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27(2.1) 

Mi 1 8 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5E 

Public School Teachers 9 Reports on Giving Students 
Time to Read Books They Have Chosen Themselves 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 
State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.5E (continued) 

Public School Teachers’ Reports on Giving Students 
Time to Read Books They Have Chosen Themselves 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 






Percentage and Proficiency 
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EDUCATION 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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1994 Trial Slate Assessment 



TABLE D6.5F 

Public School Students 9 Reports on Reading Books 
They Have Chosen Themselves 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 



State 

Nation 

RACE/ ETHNICITY 
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State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 
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Pacific Islander 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Fmg/Lrg Town 
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Rural/Small Town 

State 

Nation 
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TABLE D6.5F (continued) 

Public School Students’ Reports on Reading Books 
They Have Chosen Themselves 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 
State 

Nation 

GENDER 

Male 

State 

Nation 



Female 

State 



Nation 
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; : 66(1.9) 

229( 1.8) 

220 {.3*2) . 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.6 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 




Percentage and Proficiency 
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TOTAL 



State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 
State 

Nation 

American Indian 

State 

Nation 

TYPE OF 



LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rurat/Small Town 

State 

Nation 
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TABLE D6.6 (continued) 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Tnal State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 








1994 
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Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.7 

Public School Teachers 9 Reports on Assigning Books 
from the Library 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 






1994 




TOTAL 
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Percentage and Proficiency 
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TABLE D6.7 (continued) 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Tnal State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 






Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8A 

Public School Teachers ’ Reports on Assessing Students 
Via Multiple-Choice Tests 



1994 Trial State Assessment 



Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 


1994 
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TABLE D6.8A (continued) 

Public School Teachers’ Reports on Assessing Students 
Via Multiple-Choice Tests 



1994 Trial State Assessment 


Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 


1994 
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Nation 


io{2.o) : 


liipiWiM ' : :s 


2 . 8 ) 


/;>•: 24 ( 3 . 5 ) 
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201 (2.9) 
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37 ( 3.5) : " 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8B 

Public School Teachers y Reports on Assessing Students 
With Paragraph Length Written Responses About 
What They Have Read 



Once or Twice a 
Week 



Once or Twice a 
Month 



Once or Twice a 
Year 



Never or Hardly 
Ever 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific islander 
State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 



Percentage and Proficiency 
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*\ * ; 10 ( 1.7) 
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189 (2.8) 


M 5 j f i2:'(2.9)-^; i 
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ii 

: •- : 'f 


IpilRRWlisKji JSttB • 

5 ffi :* 
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/7<17):^: 
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■ 201 ( 3.8)1 !• p 
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■, (3.2) . 
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12 ( 2 . 6 ) 

r- ; , 6 ( 1.3) , .5 * 

- r/) 

15(7.2) 

• *♦* ffek '' ' 
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- (~ ') • • 
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. ■ 
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— r.*) 
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'i 4 ■* < f „j 

If f * 0 
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.8(2.5) 
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(continued on next page) 
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TABLE D6.8B (continued) 

Public School Teachers ’ Reports on Assessing Students 
With Paragraph Length Written Responses About 
What They Have Read 



Once or Twice a 
Week 



Once or Twice a 
Month 



Once or Twice a 
Year 



Never or Hardly 
Ever 



1994 



PARENTS ' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 
State 

Nation 

GENDER 



Percentage and Proficiency 



33:( asjiSBitti 

227(2.3) ®f§£! 

i^$siiaw 

l-fibi-pafllili 
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i’SllO.f 3. : 5).' 
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,33 (9.9) 
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State 
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: ‘ 7> 11 ( 13) * > 


KISS 12(2.4) 




n%Tg'21;i:(-2.6) ' .7 
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s;/ ! r. 


^ ' w '' ~ f ~ ? ^4, 


|l|ii |B| 8f| 
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State 
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si 
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=;:■ • 
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' : - 
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>> 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8C 

Public School Teachers ’ Reports on Assessing Students 
Via Reading Portfolios 



1994 Trial State Assessment 



Once or Twice a 


Once or Twice a 


Once or Twice a 


Never or Hardly 


Week 


Month 


Year 


Ever 


1994 




Percentage and Proficiency 


.•• j /if 
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" f ' 1 
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i inmt 1 1 in 
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1 20(2.9) 
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TOTAL 

State 

Nation 

RACE/ ETHNICfTY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

‘State 

Nation 



(continued on next page) 
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TABLE D6.8C (continued) 

Public School Teachers 9 Reports on Assessing Students 
Via Reading Portfolios 



1994 Trial State Assessment 


Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 






1994 








Percentage an 


id Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.1 

Public School Students’ Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 
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Once or Twice a 
Week 
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Month 


Never or Hardly 
Ever 
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TABLE D8.1 (continued) 

Public School Students ’ Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 




Once or Twice a 
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iasiliiiciiiiiiiBiifi 


iuMpin^ii 


Nation 


194(45) jV-j 




!Sii^3Ri2L4) ;,\> ?; 


18(2.7) 




It 1 ^92X'S:i)r 




•ipS ^ |||**^ (*?:*!)?;. l-lj f iplUil 


1 don’t know 








iffife) s- : ;v:filiE 


State 


l|l I 




|pSiS6Slii3iil 








tligli : 200;(2.6) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.2 

Public School Students’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial Stale Assessment 



None 



One or Two 



Three or Four 



Five or More 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

Asian 

State 

Nation 

Pacific Islander 
State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
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Nation 

Urb Frng/Lrg Town 
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Nation 

Rural/Small Town 
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Nation 



Percentage and Proficiency 
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TABLE D8.2 (continued) 

Public School Students ’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial Stale Assessment 


None 


One or Two 


Three or Four 


Five or More 


1994 






Percentage and Proficiency ; 
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£»Tf : . : i ?|i 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.3 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library for Their Own 
Enjoyment 



Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1994 
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TOTAL 

State 

Nation 

RACE/ EJHHICTTY 
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State 

Nation 

Black 

State 

Nation 

Hispanic 

State 
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Asian 

State 

Nation 

Pacific Islander 
State 
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American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 
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Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
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TABLE D8.3 (continued) 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library for Their Own 
Enjoyment 



Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1994 



PARENTS’ 



EDUCATION 
College graduate 

State 
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Some ed after HS 

State 
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HS graduate 

State 
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I don’t know 

State 
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GENDER 

Male 

State 
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State 
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Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.4 

Public School Students’ Reports on Types of Reading 
Materials in the Home 



1994 Trial State Assessment 
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Three Types 


Four Types 
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TABLE D8.4 (continued) 

Public School Students’ Reports on Types of Reading 
Materials in the Home 



1994 Trial Slate Assessment 


Zero to Two Types 


Three Types 


Four Types 




1994 






Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.5 

Public School Students ’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial Stale Assessment 


Almost Every Day 


Once or Twice a Week 


Less Than Weekly 






1994 




TOTAL 


* - 


Percentage and Proficiency 
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TABLE D8.5 (continued) 

Public School Students’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial State Assessment 



Almost Every Day 



Once or Twice a Week 



Less Than Weekly 



1994 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 
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Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.6 

Public School Students ’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 



One Hour or Less 



Two Hours 



Three Hours 



1994 



Percentage and Proficiency 



TOTAL 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial Stale Assessment 



One Hour or Less 


Two Hours 


Three Hours 


1994 



PARENTS' 

EDUCATION 



College graduate 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 



Four to Five Hours 



Six Hours or More 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 




THE 1994 NAEP TRIAL STATE ASSESSMENT 



195 



ACKNOWLEDGMENTS 



A very special thank you is due to the many individuals who provided invaluable assistance 
in the production of this report. Literally a cast of thousands was involved in the 
development, administration, scoring, analysis, writing, reviewing, and reporting of the 1994 
Trial State Assessment in reading. These individuals contributed their expertise, energy, and 
creativity to help make the NAEP reading assessment a success. Most importantly, NAEP is 
grateful to the students and school staff who participated in the Trial State Assessment 

The design, development, analysis, and reporting of the 1994 Trial State Assessment was a 
continuation of the collaborative effort that began in 1989 among staff from State Education 
Agencies, the National Center for Education Statistics (NCES), Educational Testing Service 
(ETS), Westat, and National Computer Systems (NCS). The Trial State Assessment Program 
continued to benefit from the contributions of hundreds of individuals at the state and local 
levels — governors, chief state school officers, state and district test directors, state 
coordinators, and district administrators — who provided their wisdom, experience, and hard 
work. 

The 1990, 1992 and 1994 Trial State Assessments were funded through NCES by the Office 
of Educational Research and Improvement of the U.S. Department of Education. The NCES 
staff — particularly Jeanne Griffith, Gary Phillips, Sheida White, Peggy Carr, Sharif Shakrani, 
Stephen Gorman, Sue Ahmed, Maureen Treacy, and Sahar Akhtar — worked closely and 
collegially with ETS, Westat, and NCS staff and played a crucial role in all aspects of the 
program. The 1994 NAEP assessments and reports benefitted from the consistent support and 
guidance of Emerson Elliott, the past Commissioner of NCES. 

The members of the National Assessment Governing Board (NAGB) and the NAGB staff 
provided continual advice and guidance. Their contractor for NAEP’s reading consensus 
project, the Council of Chief State School Officers (CCSSO), worked diligently under tight 
time constraints to create the forward-looking framework underlying the assessment. NAGB’s 
contractor for setting achievement levels, American College Testing (ACT), provided advisory 
and analytic functions in setting the achievement levels. 

NAEP also owes a debt of gratitude to the numerous panelists and consultants who provided 
their expertise and worked so conscientiously on developing the assessment, setting the 
achievement levels, and providing a framework for interpreting the results. 

The NAEP project at ETS is directed by Paul Williams and resides in the Center for the 
Assessment of Educational Progress (CAEP) managed by Archie Lapointe and Paul Williams. 
Steve Lazer managed the test development activities, and Jay Campbell and Patricia Donahue 
worked with the Reading Item Development committee to develop the assessment 
instruments. John Barone managed the data analysis activities; Jules Goodison and John 
Olson, the operational aspects; Clyde Reese and Karen Miller, reporting activities; and John 
Olson, state services and technical assistance. Statistical and psychometric activities were led 
by John Mazzeo, with consultation from Eugene Johnson. Sampling and data collection 




1 



jl 



96 



activities were carried out by Westat under the direction of Renee Slobasky, Keith Rust, and 
Nancy Caldwell. Printing, distribution, scoring, and processing activities were conducted by 
NCS, under the supervision of John O’Neill, Judy Moyer, Mathilde Kennel, Lavonne Mohn, 
Brad Thayer, and Dianne Smrdel. 

The large number of states and territories participating in the Trial State Assessment provided 
many challenges, including the need to develop different reports that are customized for each 
of the participating jurisdictions based on its characteristics and the results of its assessed 
students. To meet this challenge, a computerized report-generation system was employed that 
created text, tables, and graphics for each jurisdiction’s unique report. This system, created 
by Jennifer Nelson, was designed to take advantage of mainframe computer speed and 
accuracy for the data computations, interfaced with high-quality text formatting and graphical 
output procedures. Laura Jerry led the computer-based development of the reading report. 
John Mazzeo and Nancy Allen oversaw the analyses for the reports, with significant input 
from Steve Isham. James Carlson, Hua Hua Chang, John Donoghue, John Ferris, David 
Freund, Frank Jenkins, Bruce Kaplan, Edward Kulick, Phillip Leung, Jo-lin Liang, Eiji 
Muraki, Craig Pizzuti and Spencer Swinton collaborated to generate the data, conduct the 
analyses, and check the results. A1 Rogers developed and generated the maps. 

Stephen Koffler, Jay Campbell, and John Mazzeo wrote the text for the report. Laura Jerry 
and Karen Miller coordinated the quality control and checking of the reports. Mary Michaels 
and Sharon Johnson were responsible for coordinating the cover design and final production 
of the reports. Finally, a special thanks is also due to the numerous reviewers, internal and 
external, who suggested improvements to the reports, and the individuals who thoroughly 
checked the data, text, tables, and maps. 
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